Max level shown:
1 [ Jan 9 01:33:35 Enabled. ]
2 [ Jan 9 01:33:35 Rereading configuration. ]
3 [ Jan 9 01:33:37 Rereading configuration. ]
4 [ Jan 9 01:33:43 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Jan 9 01:33:43 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-01-09T01:33:43.739ZDEBGnexus: registered DTrace probes
82025-01-09T01:33:43.744ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242025-01-09T01:33:43.753ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612025-01-09T01:33:43.754ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622025-01-09T01:33:43.754ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632025-01-09T01:33:43.770ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642025-01-09T01:33:43.774ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652025-01-09T01:33:43.778ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662025-01-09T01:33:43.784ZDEBGnexus (ServerContext): registered USDT probes
672025-01-09T01:33:43.925ZINFOnexus: Database schema version is up to date desired_version = 118.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 118.0.0
682025-01-09T01:33:43.928ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
692025-01-09T01:33:43.934ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 338918245 } })
702025-01-09T01:33:43.935ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712025-01-09T01:33:43.987ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722025-01-09T01:33:43.987ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732025-01-09T01:33:43.990ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df080785-0fa1-4d92-8477-e3561f376853", "content-length": "26", "date": "Thu, 09 Jan 2025 01:33:43 GMT"} })
742025-01-09T01:33:43.990ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752025-01-09T01:33:43.991ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762025-01-09T01:33:44.023ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 428111909 } })
772025-01-09T01:33:44.023ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782025-01-09T01:33:44.059ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792025-01-09T01:33:44.060ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802025-01-09T01:33:44.060ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c871db4-16e4-4fab-b4ca-f203fdeb8b7f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:33:43 GMT"} })
812025-01-09T01:33:44.060ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822025-01-09T01:33:44.060ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832025-01-09T01:33:44.131ZDEBGnexus (clickhouse-client): registered USDT probes id = 632d844a-c1fb-4435-8369-746915bb8dec
842025-01-09T01:33:44.152ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852025-01-09T01:33:44.164ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862025-01-09T01:33:44.168ZDEBGnexus (DataLoader): attempting to create built-in users
872025-01-09T01:33:44.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882025-01-09T01:33:44.168ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
912025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
922025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
942025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
952025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1012025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1032025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1062025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1082025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1092025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1122025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1142025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1162025-01-09T01:33:44.195ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1182025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1192025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1212025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1222025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1262025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1272025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1282025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1292025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302025-01-09T01:33:44.196ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312025-01-09T01:33:44.197ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:60547
1322025-01-09T01:33:44.210ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1332025-01-09T01:33:44.210ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1342025-01-09T01:33:44.211ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352025-01-09T01:33:44.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 0b17304d-f568-4041-b0fc-ab7eedc63274 roles = RoleSet { roles: {} } uri = /metrics/collectors
1362025-01-09T01:33:44.213ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1372025-01-09T01:33:44.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 0b17304d-f568-4041-b0fc-ab7eedc63274 resource = Database result = Ok(()) uri = /metrics/collectors
1382025-01-09T01:33:44.219ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1392025-01-09T01:33:44.219ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402025-01-09T01:33:44.220ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412025-01-09T01:33:44.220ZDEBGnexus (DataLoader): attempting to create built-in roles
1422025-01-09T01:33:44.220ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432025-01-09T01:33:44.221ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442025-01-09T01:33:44.239ZWARNnexus: Cannot look up rack: Object (of type ById(59b29299-38cc-4366-91a5-ce2131096a5f)) not found: rack file = nexus/src/app/rack.rs:774
1452025-01-09T01:33:44.280ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:41
1462025-01-09T01:33:44.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82238 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 0b17304d-f568-4041-b0fc-ab7eedc63274 response_code = 204 uri = /metrics/collectors
1472025-01-09T01:33:44.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d1137a25-3976-4e1c-b44f-300be5fca812 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
1482025-01-09T01:33:44.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d1137a25-3976-4e1c-b44f-300be5fca812 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
1492025-01-09T01:33:44.299ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1502025-01-09T01:33:44.299ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512025-01-09T01:33:44.300ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522025-01-09T01:33:44.300ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1532025-01-09T01:33:44.300ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542025-01-09T01:33:44.300ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552025-01-09T01:33:44.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d1137a25-3976-4e1c-b44f-300be5fca812 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
1562025-01-09T01:33:44.533ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1572025-01-09T01:33:44.533ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582025-01-09T01:33:44.535ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592025-01-09T01:33:44.535ZDEBGnexus (DataLoader): attempting to create built-in silos
1602025-01-09T01:33:44.535ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612025-01-09T01:33:44.535ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622025-01-09T01:33:44.670ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1632025-01-09T01:33:44.671ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642025-01-09T01:33:44.672ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652025-01-09T01:33:44.692ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662025-01-09T01:33:44.693ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672025-01-09T01:33:44.693ZDEBGnexus (DataLoader): attempting to create built-in projects
1682025-01-09T01:33:44.693ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692025-01-09T01:33:44.693ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702025-01-09T01:33:44.714ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712025-01-09T01:33:44.715ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722025-01-09T01:33:44.757ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732025-01-09T01:33:44.757ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1742025-01-09T01:33:45.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752025-01-09T01:33:45.168ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1762025-01-09T01:33:45.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772025-01-09T01:33:45.168ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782025-01-09T01:33:45.203ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792025-01-09T01:33:45.203ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802025-01-09T01:33:45.776ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812025-01-09T01:33:45.777ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1822025-01-09T01:33:45.778ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832025-01-09T01:33:45.778ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842025-01-09T01:33:45.809ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1852025-01-09T01:33:45.809ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862025-01-09T01:33:45.809ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872025-01-09T01:33:45.809ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1882025-01-09T01:33:45.810ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892025-01-09T01:33:45.810ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902025-01-09T01:33:45.813ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912025-01-09T01:33:45.813ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922025-01-09T01:33:45.815ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932025-01-09T01:33:45.816ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942025-01-09T01:33:45.817ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952025-01-09T01:33:45.817ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962025-01-09T01:33:45.819ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972025-01-09T01:33:45.819ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982025-01-09T01:33:45.821ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992025-01-09T01:33:45.823ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2002025-01-09T01:33:45.823ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012025-01-09T01:33:45.823ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022025-01-09T01:33:45.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032025-01-09T01:33:45.825ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042025-01-09T01:33:45.826ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052025-01-09T01:33:45.826ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062025-01-09T01:33:45.837ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072025-01-09T01:33:45.839ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2082025-01-09T01:33:45.839ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092025-01-09T01:33:45.839ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102025-01-09T01:33:46.031ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112025-01-09T01:33:46.031ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122025-01-09T01:33:46.033ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132025-01-09T01:33:46.034ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142025-01-09T01:33:46.035ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152025-01-09T01:33:46.035ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162025-01-09T01:33:46.047ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172025-01-09T01:33:46.050ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2182025-01-09T01:33:46.050ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192025-01-09T01:33:46.050ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202025-01-09T01:33:46.073ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212025-01-09T01:33:46.073ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222025-01-09T01:33:46.078ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232025-01-09T01:33:46.078ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242025-01-09T01:33:46.081ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252025-01-09T01:33:46.081ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262025-01-09T01:33:46.082ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272025-01-09T01:33:46.082ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282025-01-09T01:33:46.084ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292025-01-09T01:33:46.084ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302025-01-09T01:33:46.085ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312025-01-09T01:33:46.085ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322025-01-09T01:33:46.087ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332025-01-09T01:33:46.087ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342025-01-09T01:33:46.088ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352025-01-09T01:33:46.091ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2362025-01-09T01:33:46.091ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372025-01-09T01:33:46.092ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382025-01-09T01:33:46.092ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392025-01-09T01:33:46.093ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402025-01-09T01:33:46.094ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412025-01-09T01:33:46.094ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422025-01-09T01:33:46.095ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432025-01-09T01:33:46.098ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2442025-01-09T01:33:46.098ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452025-01-09T01:33:46.098ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462025-01-09T01:33:46.140ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472025-01-09T01:33:46.140ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482025-01-09T01:33:46.142ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492025-01-09T01:33:46.142ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502025-01-09T01:33:46.143ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512025-01-09T01:33:46.143ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522025-01-09T01:33:46.144ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532025-01-09T01:33:46.148ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2542025-01-09T01:33:46.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552025-01-09T01:33:46.148ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562025-01-09T01:33:46.240ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2572025-01-09T01:33:46.241ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2582025-01-09T01:33:46.241ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2592025-01-09T01:33:46.241ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602025-01-09T01:33:46.241ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612025-01-09T01:33:46.242ZWARNnexus: Cannot look up rack: Object (of type ById(59b29299-38cc-4366-91a5-ce2131096a5f)) not found: rack file = nexus/src/app/rack.rs:774
2622025-01-09T01:33:46.246ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632025-01-09T01:33:46.246ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642025-01-09T01:33:46.247ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652025-01-09T01:33:46.247ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662025-01-09T01:33:46.249ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672025-01-09T01:33:46.249ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682025-01-09T01:33:46.250ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692025-01-09T01:33:46.251ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702025-01-09T01:33:46.252ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712025-01-09T01:33:46.252ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722025-01-09T01:33:46.253ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732025-01-09T01:33:46.256ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2742025-01-09T01:33:46.256ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752025-01-09T01:33:46.256ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762025-01-09T01:33:46.257ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772025-01-09T01:33:46.257ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782025-01-09T01:33:46.258ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792025-01-09T01:33:46.259ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802025-01-09T01:33:46.260ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812025-01-09T01:33:46.263ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2822025-01-09T01:33:46.263ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832025-01-09T01:33:46.263ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842025-01-09T01:33:46.286ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852025-01-09T01:33:46.286ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862025-01-09T01:33:46.287ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872025-01-09T01:33:46.287ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882025-01-09T01:33:46.288ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892025-01-09T01:33:46.288ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902025-01-09T01:33:46.289ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912025-01-09T01:33:46.292ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2922025-01-09T01:33:46.292ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932025-01-09T01:33:46.292ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942025-01-09T01:33:46.379ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2952025-01-09T01:33:46.379ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2962025-01-09T01:33:46.379ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972025-01-09T01:33:46.379ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982025-01-09T01:33:46.388ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992025-01-09T01:33:46.389ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002025-01-09T01:33:46.390ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012025-01-09T01:33:46.390ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022025-01-09T01:33:46.392ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032025-01-09T01:33:46.392ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042025-01-09T01:33:46.393ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052025-01-09T01:33:46.393ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062025-01-09T01:33:46.395ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072025-01-09T01:33:46.395ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082025-01-09T01:33:46.396ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092025-01-09T01:33:46.399ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3102025-01-09T01:33:46.399ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112025-01-09T01:33:46.399ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122025-01-09T01:33:46.402ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132025-01-09T01:33:46.402ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142025-01-09T01:33:46.403ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152025-01-09T01:33:46.403ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162025-01-09T01:33:46.405ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172025-01-09T01:33:46.405ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182025-01-09T01:33:46.407ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192025-01-09T01:33:46.407ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202025-01-09T01:33:46.408ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212025-01-09T01:33:46.408ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222025-01-09T01:33:46.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232025-01-09T01:33:46.409ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242025-01-09T01:33:46.410ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252025-01-09T01:33:46.415ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3262025-01-09T01:33:46.415ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272025-01-09T01:33:46.416ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282025-01-09T01:33:46.436ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292025-01-09T01:33:46.436ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302025-01-09T01:33:46.438ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312025-01-09T01:33:46.438ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322025-01-09T01:33:46.439ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332025-01-09T01:33:46.440ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342025-01-09T01:33:46.441ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352025-01-09T01:33:46.441ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362025-01-09T01:33:46.442ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372025-01-09T01:33:46.443ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382025-01-09T01:33:46.444ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392025-01-09T01:33:46.445ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402025-01-09T01:33:46.446ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412025-01-09T01:33:46.449ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3422025-01-09T01:33:46.449ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432025-01-09T01:33:46.450ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442025-01-09T01:33:46.454ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452025-01-09T01:33:46.454ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462025-01-09T01:33:46.455ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472025-01-09T01:33:46.456ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482025-01-09T01:33:46.457ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492025-01-09T01:33:46.457ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502025-01-09T01:33:46.458ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512025-01-09T01:33:46.461ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3522025-01-09T01:33:46.470ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532025-01-09T01:33:46.470ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542025-01-09T01:33:46.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552025-01-09T01:33:46.518ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562025-01-09T01:33:46.523ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572025-01-09T01:33:46.523ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582025-01-09T01:33:46.524ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592025-01-09T01:33:46.525ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602025-01-09T01:33:46.526ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612025-01-09T01:33:46.526ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622025-01-09T01:33:46.533ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632025-01-09T01:33:46.536ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3642025-01-09T01:33:46.536ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652025-01-09T01:33:46.536ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662025-01-09T01:33:46.550ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3672025-01-09T01:33:46.550ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3682025-01-09T01:33:46.550ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692025-01-09T01:33:46.551ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702025-01-09T01:33:46.551ZDEBGnexus (DataLoader): attempting to create silo users
3712025-01-09T01:33:46.551ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722025-01-09T01:33:46.551ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732025-01-09T01:33:46.561ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3742025-01-09T01:33:46.561ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3752025-01-09T01:33:46.561ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762025-01-09T01:33:46.561ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3772025-01-09T01:33:46.563ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3782025-01-09T01:33:46.563ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3792025-01-09T01:33:46.563ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3802025-01-09T01:33:46.565ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3812025-01-09T01:33:46.565ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3822025-01-09T01:33:46.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3832025-01-09T01:33:46.584ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3842025-01-09T01:33:46.585ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3852025-01-09T01:33:46.586ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3862025-01-09T01:33:46.586ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3872025-01-09T01:33:46.586ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3882025-01-09T01:33:46.596ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
3892025-01-09T01:33:46.596ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
3902025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3912025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3922025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3932025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3942025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3952025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3962025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3972025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3982025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3992025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4002025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4012025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4022025-01-09T01:33:46.599ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:23:46.599471350 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4032025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4042025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4052025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4062025-01-09T01:33:46.599ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4072025-01-09T01:33:46.599ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4082025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 27.59\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4092025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 33.94\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4102025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4112025-01-09T01:33:46.599ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4122025-01-09T01:33:46.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.55\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4132025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4142025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4152025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4162025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4172025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4182025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4192025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4202025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4212025-01-09T01:33:46.600ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4222025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 9.63\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4232025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4242025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4252025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4262025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4272025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4282025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4292025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4302025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4312025-01-09T01:33:46.600ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4322025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4332025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4342025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4352025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4362025-01-09T01:33:46.600ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4372025-01-09T01:33:46.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4382025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4392025-01-09T01:33:46.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4402025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4412025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4422025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4432025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4442025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4452025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4462025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4472025-01-09T01:33:46.601ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 959, tv_nsec: 6202220 } })
4482025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4492025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4502025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4512025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4522025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4532025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4542025-01-09T01:33:46.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4552025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4562025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4572025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4582025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4592025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4602025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4612025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4622025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4632025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4642025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4652025-01-09T01:33:46.602ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4662025-01-09T01:33:46.602ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4672025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4682025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4692025-01-09T01:33:46.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 959, tv_nsec: 7065805 } })
4702025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4712025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4722025-01-09T01:33:46.602ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4732025-01-09T01:33:46.602ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4742025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.579317ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4752025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4762025-01-09T01:33:46.602ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4772025-01-09T01:33:46.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 2.81\u{b5}s iteration = 2 status = {"error":"no config"}
4782025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4792025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4802025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4812025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4822025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4832025-01-09T01:33:46.603ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4842025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4852025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.087336ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4862025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4872025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4882025-01-09T01:33:46.603ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4892025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 6.07\u{b5}s iteration = 2 status = {"error":"no config"}
4902025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4912025-01-09T01:33:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4922025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4932025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4942025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4962025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4972025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4982025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4992025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5002025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5012025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5022025-01-09T01:33:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5032025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5042025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5052025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5062025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5072025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5082025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5092025-01-09T01:33:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5102025-01-09T01:33:46.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5112025-01-09T01:33:46.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5122025-01-09T01:33:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5132025-01-09T01:33:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5142025-01-09T01:33:46.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5152025-01-09T01:33:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5162025-01-09T01:33:46.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5172025-01-09T01:33:46.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5182025-01-09T01:33:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5192025-01-09T01:33:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5202025-01-09T01:33:46.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5212025-01-09T01:33:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5222025-01-09T01:33:46.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 959, tv_nsec: 34679469 } })
5232025-01-09T01:33:46.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5242025-01-09T01:33:46.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5252025-01-09T01:33:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5262025-01-09T01:33:46.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5272025-01-09T01:33:46.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5282025-01-09T01:33:46.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 959, tv_nsec: 49914344 } })
5292025-01-09T01:33:46.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5302025-01-09T01:33:46.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5312025-01-09T01:33:46.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5322025-01-09T01:33:46.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5332025-01-09T01:33:46.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5342025-01-09T01:33:46.673ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5352025-01-09T01:33:46.673ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 71.741844ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5362025-01-09T01:33:46.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5372025-01-09T01:33:46.682ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5382025-01-09T01:33:46.683ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5392025-01-09T01:33:46.684ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 84.701192ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5402025-01-09T01:33:46.684ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a20519-1daf-4fbe-b5b0-1856bada41b2", "content-length": "26", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
5412025-01-09T01:33:46.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5422025-01-09T01:33:46.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5432025-01-09T01:33:46.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5442025-01-09T01:33:46.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5452025-01-09T01:33:46.687ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5462025-01-09T01:33:46.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5472025-01-09T01:33:46.688ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5482025-01-09T01:33:46.688ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5492025-01-09T01:33:46.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5502025-01-09T01:33:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5512025-01-09T01:33:46.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5522025-01-09T01:33:46.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5532025-01-09T01:33:46.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542025-01-09T01:33:46.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5552025-01-09T01:33:46.691ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5562025-01-09T01:33:46.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5572025-01-09T01:33:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5582025-01-09T01:33:46.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5592025-01-09T01:33:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5602025-01-09T01:33:46.696ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5612025-01-09T01:33:46.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5622025-01-09T01:33:46.700ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:23:46.599471350 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5632025-01-09T01:33:46.700ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 101.442102ms iteration = 1 status = {"expiration":"2025-01-09T01:23:46.599471350Z","pruned":[]}
5642025-01-09T01:33:46.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5652025-01-09T01:33:46.703ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5662025-01-09T01:33:46.703ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672025-01-09T01:33:46.704ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f66ee27-a8b9-4730-a4cb-3c935cae057e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
5682025-01-09T01:33:46.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5692025-01-09T01:33:46.705ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 104.865957ms iteration = 1 status = {}
5702025-01-09T01:33:46.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5712025-01-09T01:33:46.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5722025-01-09T01:33:46.706ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5732025-01-09T01:33:46.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5742025-01-09T01:33:46.712ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 110.63666ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5752025-01-09T01:33:46.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762025-01-09T01:33:46.716ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772025-01-09T01:33:46.717ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5782025-01-09T01:33:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5792025-01-09T01:33:46.719ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5802025-01-09T01:33:46.719ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5812025-01-09T01:33:46.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5822025-01-09T01:33:46.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5832025-01-09T01:33:46.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5842025-01-09T01:33:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5852025-01-09T01:33:46.726ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
5862025-01-09T01:33:46.726ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.280891ms iteration = 1 status = {"error":"rack not yet initialized: 59b29299-38cc-4366-91a5-ce2131096a5f"}
5872025-01-09T01:33:46.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5882025-01-09T01:33:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5892025-01-09T01:33:46.733ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5902025-01-09T01:33:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5912025-01-09T01:33:46.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922025-01-09T01:33:46.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 133.801522ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
5932025-01-09T01:33:46.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5942025-01-09T01:33:46.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5952025-01-09T01:33:46.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5962025-01-09T01:33:46.760ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5972025-01-09T01:33:46.768ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa5898f-e19a-4a4c-b2af-390cf2eecc44", "content-length": "1", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
5982025-01-09T01:33:46.770ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5992025-01-09T01:33:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6002025-01-09T01:33:46.770ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
6012025-01-09T01:33:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.680466ms iteration = 1 status = {"error":"inventory collection is None"}
6022025-01-09T01:33:46.771ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6032025-01-09T01:33:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 171.60463ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6042025-01-09T01:33:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 169.228112ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6052025-01-09T01:33:46.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062025-01-09T01:33:46.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6072025-01-09T01:33:46.795ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.508691ms iteration = 1 status = {}
6082025-01-09T01:33:46.811ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.587174ms iteration = 1 status = null
6092025-01-09T01:33:46.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6102025-01-09T01:33:46.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6112025-01-09T01:33:46.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 224.874677ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6122025-01-09T01:33:46.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132025-01-09T01:33:46.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6142025-01-09T01:33:46.843ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6152025-01-09T01:33:46.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6162025-01-09T01:33:46.844ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6172025-01-09T01:33:46.844ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6182025-01-09T01:33:46.844ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 242.167436ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6192025-01-09T01:33:46.844ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6202025-01-09T01:33:46.845ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 959, tv_nsec: 249811399 } })
6212025-01-09T01:33:46.851ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6222025-01-09T01:33:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 250.990278ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6232025-01-09T01:33:46.853ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6242025-01-09T01:33:46.853ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6252025-01-09T01:33:46.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6262025-01-09T01:33:46.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6272025-01-09T01:33:46.859ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6282025-01-09T01:33:46.859ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6292025-01-09T01:33:46.859ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 258.893925ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6302025-01-09T01:33:46.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6312025-01-09T01:33:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6322025-01-09T01:33:46.879ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6332025-01-09T01:33:46.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 279.950533ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6342025-01-09T01:33:46.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6352025-01-09T01:33:46.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6362025-01-09T01:33:46.882ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6372025-01-09T01:33:46.882ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 283.375079ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6382025-01-09T01:33:46.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6392025-01-09T01:33:46.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6402025-01-09T01:33:46.889ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6412025-01-09T01:33:46.889ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6422025-01-09T01:33:46.889ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6432025-01-09T01:33:46.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6442025-01-09T01:33:46.890ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de630ce-2976-49ca-80dd-bdc7221d0459", "content-length": "476", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6452025-01-09T01:33:46.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6462025-01-09T01:33:46.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6472025-01-09T01:33:46.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6482025-01-09T01:33:46.892ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6492025-01-09T01:33:46.892ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbb6e626-c4d5-47e1-896b-8f802e4acb3b", "content-length": "734", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6502025-01-09T01:33:46.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6512025-01-09T01:33:46.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 290.481103ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6522025-01-09T01:33:46.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6532025-01-09T01:33:46.895ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2171fcf1-6c78-4b28-91b2-8b0f114d029e", "content-length": "111", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6542025-01-09T01:33:46.895ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6552025-01-09T01:33:46.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3f8e9b7-1a62-4ed6-bbce-360e59e8d123", "content-length": "111", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6562025-01-09T01:33:46.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6572025-01-09T01:33:46.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b280074d-9d03-4c3c-b2cf-24fc547017df", "content-length": "167", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6582025-01-09T01:33:46.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6592025-01-09T01:33:46.896ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b91b0fb-d955-4e25-a157-4ba205fcbe3c", "content-length": "167", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6602025-01-09T01:33:46.896ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6612025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dfd827f-c78c-414f-ad34-be5d51922a2e", "content-length": "175", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6622025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6632025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6642025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6652025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "643ee3d0-82d9-4897-bc30-446078e3c5c2", "content-length": "175", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6662025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6672025-01-09T01:33:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6682025-01-09T01:33:46.898ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6692025-01-09T01:33:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 299.371356ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6702025-01-09T01:33:46.900ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf3a7ac5-b65f-4761-abb4-725e597b5f56", "content-length": "702", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6712025-01-09T01:33:46.903ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6722025-01-09T01:33:46.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732025-01-09T01:33:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742025-01-09T01:33:46.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6752025-01-09T01:33:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6762025-01-09T01:33:46.910ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "66a480f6-3456-49ff-a5bc-edcad6a997e6", "content-length": "727", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6772025-01-09T01:33:46.910ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6782025-01-09T01:33:46.910ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed13b4a2-6e0c-4633-a63a-75026eafaa69", "content-length": "729", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6792025-01-09T01:33:46.910ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6802025-01-09T01:33:46.911ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b3381b6-b1c7-493e-b443-d8ef5c2a9677", "content-length": "728", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6812025-01-09T01:33:46.911ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6822025-01-09T01:33:46.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6832025-01-09T01:33:46.911ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8b59955-f19f-4b8a-accd-99e918b9d18d", "content-length": "722", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6842025-01-09T01:33:46.911ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6852025-01-09T01:33:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6862025-01-09T01:33:46.912ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "89103b0b-d041-4b5a-8aaf-707f1ae54fea", "content-length": "109", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6872025-01-09T01:33:46.912ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6882025-01-09T01:33:46.912ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "30055b0e-7352-405f-b0b6-9f0dab6c6380", "content-length": "109", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6892025-01-09T01:33:46.912ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6902025-01-09T01:33:46.912ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f81a86e-b651-4cee-af48-36e812e40e1c", "content-length": "169", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6912025-01-09T01:33:46.912ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6922025-01-09T01:33:46.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6932025-01-09T01:33:46.913ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e1e63f3-db95-44f0-91be-42ffe58ca059", "content-length": "169", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6942025-01-09T01:33:46.913ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6952025-01-09T01:33:46.914ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1438961-2796-4b66-9ebc-54287432bc69", "content-length": "178", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6962025-01-09T01:33:46.914ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6972025-01-09T01:33:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6982025-01-09T01:33:46.915ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d99aa939-1996-4b60-beab-3a935aab5f3c", "content-length": "178", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
6992025-01-09T01:33:46.915ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7002025-01-09T01:33:46.915ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb1ba3b0-8fb8-4f4c-8107-f2286bb4cb29", "content-length": "702", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
7012025-01-09T01:33:46.915ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7022025-01-09T01:33:46.915ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e99b063-3d94-45b5-b131-ce0b79861a09", "content-length": "727", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
7032025-01-09T01:33:46.915ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7042025-01-09T01:33:46.916ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70d1c535-a2be-4558-a9a0-4393bb950822", "content-length": "729", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
7052025-01-09T01:33:46.916ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7062025-01-09T01:33:46.916ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2473b8c-3aab-4376-8af7-4af232addadc", "content-length": "728", "date": "Thu, 09 Jan 2025 01:33:46 GMT"} })
7072025-01-09T01:33:46.916ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7082025-01-09T01:33:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7092025-01-09T01:33:46.920ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.788174ms iteration = 1 status = {}
7102025-01-09T01:33:46.924ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112025-01-09T01:33:46.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7122025-01-09T01:33:46.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7132025-01-09T01:33:46.927ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7142025-01-09T01:33:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7152025-01-09T01:33:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7162025-01-09T01:33:46.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7172025-01-09T01:33:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7182025-01-09T01:33:46.932ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192025-01-09T01:33:46.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7202025-01-09T01:33:46.935ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7212025-01-09T01:33:46.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7222025-01-09T01:33:46.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 340.126721ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7232025-01-09T01:33:46.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 374.315821ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7242025-01-09T01:33:47.000ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7252025-01-09T01:33:47.000ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7262025-01-09T01:33:47.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7272025-01-09T01:33:47.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282025-01-09T01:33:47.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7292025-01-09T01:33:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7302025-01-09T01:33:47.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7312025-01-09T01:33:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7322025-01-09T01:33:47.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7332025-01-09T01:33:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7342025-01-09T01:33:47.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7352025-01-09T01:33:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362025-01-09T01:33:47.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7372025-01-09T01:33:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7382025-01-09T01:33:47.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7392025-01-09T01:33:47.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7402025-01-09T01:33:47.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7412025-01-09T01:33:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7422025-01-09T01:33:47.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7432025-01-09T01:33:47.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442025-01-09T01:33:47.050ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452025-01-09T01:33:47.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462025-01-09T01:33:47.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472025-01-09T01:33:47.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7482025-01-09T01:33:47.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492025-01-09T01:33:47.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502025-01-09T01:33:47.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7512025-01-09T01:33:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7522025-01-09T01:33:47.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7532025-01-09T01:33:47.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7542025-01-09T01:33:47.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552025-01-09T01:33:47.080ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7562025-01-09T01:33:47.080ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 480.313366ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7572025-01-09T01:33:47.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7582025-01-09T01:33:47.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7592025-01-09T01:33:47.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7602025-01-09T01:33:47.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7612025-01-09T01:33:47.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7622025-01-09T01:33:47.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7632025-01-09T01:33:47.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7642025-01-09T01:33:47.099ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7652025-01-09T01:33:47.099ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7662025-01-09T01:33:47.099ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 499.437285ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7672025-01-09T01:33:47.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682025-01-09T01:33:47.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692025-01-09T01:33:47.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702025-01-09T01:33:47.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712025-01-09T01:33:47.106ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7722025-01-09T01:33:47.106ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7732025-01-09T01:33:47.106ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7742025-01-09T01:33:47.107ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7752025-01-09T01:33:47.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7762025-01-09T01:33:47.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7772025-01-09T01:33:47.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7782025-01-09T01:33:47.109ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792025-01-09T01:33:47.111ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802025-01-09T01:33:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812025-01-09T01:33:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7822025-01-09T01:33:47.111ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7832025-01-09T01:33:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7842025-01-09T01:33:47.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7852025-01-09T01:33:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7862025-01-09T01:33:47.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872025-01-09T01:33:47.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7882025-01-09T01:33:47.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892025-01-09T01:33:47.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902025-01-09T01:33:47.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7912025-01-09T01:33:47.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7922025-01-09T01:33:47.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7932025-01-09T01:33:47.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7942025-01-09T01:33:47.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7952025-01-09T01:33:47.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7962025-01-09T01:33:47.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972025-01-09T01:33:47.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982025-01-09T01:33:47.142ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7992025-01-09T01:33:47.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8002025-01-09T01:33:47.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8012025-01-09T01:33:47.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022025-01-09T01:33:47.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8032025-01-09T01:33:47.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8042025-01-09T01:33:47.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8052025-01-09T01:33:47.174ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8062025-01-09T01:33:47.174ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8072025-01-09T01:33:47.174ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8082025-01-09T01:33:47.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8092025-01-09T01:33:47.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8102025-01-09T01:33:47.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112025-01-09T01:33:47.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8122025-01-09T01:33:47.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8132025-01-09T01:33:47.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8142025-01-09T01:33:47.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8152025-01-09T01:33:47.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8162025-01-09T01:33:47.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8172025-01-09T01:33:47.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8182025-01-09T01:33:47.188ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 588.053499ms iteration = 1 status = {}
8192025-01-09T01:33:47.353ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8202025-01-09T01:33:47.353ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8212025-01-09T01:33:47.353ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8222025-01-09T01:33:47.354ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 752.950901ms
8232025-01-09T01:33:47.354ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 752.986352ms iteration = 1 status = {}
8242025-01-09T01:33:47.379ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2042c7d1-dda3-4a79-8fe3-7040faeae11f file = nexus/db-queries/src/db/datastore/inventory.rs:1010
8252025-01-09T01:33:47.379ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2042c7d1-dda3-4a79-8fe3-7040faeae11f time_started = 2025-01-09 01:33:46.888561 UTC
8262025-01-09T01:33:47.379ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 778.829358ms iteration = 1 status = {"collection_id":"2042c7d1-dda3-4a79-8fe3-7040faeae11f","time_done":"2025-01-09 01:33:47.106340 UTC","time_started":"2025-01-09 01:33:46.888561 UTC"}
8272025-01-09T01:33:47.379ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8282025-01-09T01:33:47.379ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8292025-01-09T01:33:47.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8302025-01-09T01:33:47.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8312025-01-09T01:33:47.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8322025-01-09T01:33:47.383ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8332025-01-09T01:33:47.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8342025-01-09T01:33:47.385ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
8352025-01-09T01:33:47.385ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.882694ms iteration = 2 status = {"error":"rack not yet initialized: 59b29299-38cc-4366-91a5-ce2131096a5f"}
8362025-01-09T01:33:48.243ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8372025-01-09T01:33:48.243ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8382025-01-09T01:33:48.245ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8392025-01-09T01:33:48.245ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8402025-01-09T01:33:48.247ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8412025-01-09T01:33:48.250ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
8422025-01-09T01:33:48.250ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8432025-01-09T01:33:50.251ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8442025-01-09T01:33:50.251ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8452025-01-09T01:33:50.253ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8462025-01-09T01:33:50.253ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8472025-01-09T01:33:50.255ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8482025-01-09T01:33:50.258ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
8492025-01-09T01:33:50.258ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8502025-01-09T01:33:52.259ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8512025-01-09T01:33:52.259ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8522025-01-09T01:33:52.260ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8532025-01-09T01:33:52.260ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8542025-01-09T01:33:52.262ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552025-01-09T01:33:52.264ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
8562025-01-09T01:33:52.264ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8572025-01-09T01:33:54.265ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8582025-01-09T01:33:54.266ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8592025-01-09T01:33:54.267ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8602025-01-09T01:33:54.267ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8612025-01-09T01:33:54.269ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622025-01-09T01:33:54.272ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
8632025-01-09T01:33:54.272ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8642025-01-09T01:33:56.273ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8652025-01-09T01:33:56.274ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8662025-01-09T01:33:56.275ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8672025-01-09T01:33:56.276ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8682025-01-09T01:33:56.277ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8692025-01-09T01:33:56.280ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
8702025-01-09T01:33:56.280ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8712025-01-09T01:33:56.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
8722025-01-09T01:33:56.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8732025-01-09T01:33:56.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8742025-01-09T01:33:56.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
8752025-01-09T01:33:56.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8762025-01-09T01:33:56.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8772025-01-09T01:33:56.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782025-01-09T01:33:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8792025-01-09T01:33:56.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8802025-01-09T01:33:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8812025-01-09T01:33:56.605ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
8822025-01-09T01:33:56.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.571546ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
8832025-01-09T01:33:56.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8842025-01-09T01:33:56.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8852025-01-09T01:33:56.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.866584ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8862025-01-09T01:33:58.281ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8872025-01-09T01:33:58.281ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8882025-01-09T01:33:58.282ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8892025-01-09T01:33:58.283ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8902025-01-09T01:33:58.284ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8912025-01-09T01:33:58.286ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
8922025-01-09T01:33:58.286ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8932025-01-09T01:33:59.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 72bd111f-5ec0-41e5-a9e0-1bcacdafca58 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
8942025-01-09T01:33:59.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 72bd111f-5ec0-41e5-a9e0-1bcacdafca58 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
8952025-01-09T01:33:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 72bd111f-5ec0-41e5-a9e0-1bcacdafca58 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
8962025-01-09T01:34:00.287ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8972025-01-09T01:34:00.287ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8982025-01-09T01:34:00.289ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8992025-01-09T01:34:00.289ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9002025-01-09T01:34:00.291ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9012025-01-09T01:34:00.294ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9022025-01-09T01:34:00.294ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9032025-01-09T01:34:02.295ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9042025-01-09T01:34:02.295ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9052025-01-09T01:34:02.296ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9062025-01-09T01:34:02.297ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9072025-01-09T01:34:02.298ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082025-01-09T01:34:02.301ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9092025-01-09T01:34:02.301ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9102025-01-09T01:34:04.301ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9112025-01-09T01:34:04.302ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9122025-01-09T01:34:04.303ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9132025-01-09T01:34:04.304ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9142025-01-09T01:34:04.305ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9152025-01-09T01:34:04.308ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9162025-01-09T01:34:04.308ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9172025-01-09T01:34:06.309ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9182025-01-09T01:34:06.309ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9192025-01-09T01:34:06.311ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9202025-01-09T01:34:06.311ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9212025-01-09T01:34:06.312ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222025-01-09T01:34:06.315ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9232025-01-09T01:34:06.315ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9242025-01-09T01:34:06.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
9252025-01-09T01:34:06.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9262025-01-09T01:34:06.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9272025-01-09T01:34:06.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
9282025-01-09T01:34:06.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9292025-01-09T01:34:06.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9302025-01-09T01:34:06.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312025-01-09T01:34:06.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9322025-01-09T01:34:06.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9332025-01-09T01:34:06.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9342025-01-09T01:34:06.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9352025-01-09T01:34:06.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9362025-01-09T01:34:06.607ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9372025-01-09T01:34:06.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.86262ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9382025-01-09T01:34:06.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.410849ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9392025-01-09T01:34:08.316ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9402025-01-09T01:34:08.316ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9412025-01-09T01:34:08.318ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9422025-01-09T01:34:08.318ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9432025-01-09T01:34:08.320ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442025-01-09T01:34:08.322ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9452025-01-09T01:34:08.322ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9462025-01-09T01:34:10.323ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9472025-01-09T01:34:10.324ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9482025-01-09T01:34:10.325ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9492025-01-09T01:34:10.325ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9502025-01-09T01:34:10.327ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9512025-01-09T01:34:10.330ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9522025-01-09T01:34:10.330ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9532025-01-09T01:34:12.330ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9542025-01-09T01:34:12.331ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9552025-01-09T01:34:12.332ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9562025-01-09T01:34:12.332ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9572025-01-09T01:34:12.334ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582025-01-09T01:34:12.336ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9592025-01-09T01:34:12.336ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9602025-01-09T01:34:14.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 8fdcb49b-46c0-4b7e-a7fc-83be03de7bf2 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
9612025-01-09T01:34:14.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 8fdcb49b-46c0-4b7e-a7fc-83be03de7bf2 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
9622025-01-09T01:34:14.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 8fdcb49b-46c0-4b7e-a7fc-83be03de7bf2 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
9632025-01-09T01:34:14.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 7aeab305-c50d-4fb4-9c5d-0e33f667786e roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MmQ4OTk4Mi1kMzczLTQwMzQtOGFlMS0yMWYyNjM5YmYwOWYifX0%3D
9642025-01-09T01:34:14.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 7aeab305-c50d-4fb4-9c5d-0e33f667786e resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MmQ4OTk4Mi1kMzczLTQwMzQtOGFlMS0yMWYyNjM5YmYwOWYifX0%3D
9652025-01-09T01:34:14.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 7aeab305-c50d-4fb4-9c5d-0e33f667786e response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MmQ4OTk4Mi1kMzczLTQwMzQtOGFlMS0yMWYyNjM5YmYwOWYifX0%3D
9662025-01-09T01:34:14.337ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9672025-01-09T01:34:14.338ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9682025-01-09T01:34:14.339ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9692025-01-09T01:34:14.339ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9702025-01-09T01:34:14.341ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712025-01-09T01:34:14.344ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9722025-01-09T01:34:14.344ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9732025-01-09T01:34:16.344ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9742025-01-09T01:34:16.345ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9752025-01-09T01:34:16.346ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9762025-01-09T01:34:16.346ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9772025-01-09T01:34:16.347ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782025-01-09T01:34:16.350ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
9792025-01-09T01:34:16.350ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9802025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
9812025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
9822025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9832025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
9842025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9852025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9862025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
9872025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9882025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9892025-01-09T01:34:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9902025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
9912025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
9922025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
9932025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9942025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9952025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
9962025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9972025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9982025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9992025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
10002025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
10012025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10022025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10032025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
10042025-01-09T01:34:16.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10052025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
10062025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10072025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10082025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
10092025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10102025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10112025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10122025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10132025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10142025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10152025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10162025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10172025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10182025-01-09T01:34:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10192025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
10202025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10212025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
10222025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10232025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
10242025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10252025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
10262025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10272025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10282025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10312025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10322025-01-09T01:34:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10332025-01-09T01:34:16.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 989, tv_nsec: 9930911 } })
10342025-01-09T01:34:16.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10352025-01-09T01:34:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10362025-01-09T01:34:16.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10372025-01-09T01:34:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10382025-01-09T01:34:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10392025-01-09T01:34:16.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10402025-01-09T01:34:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10412025-01-09T01:34:16.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422025-01-09T01:34:16.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432025-01-09T01:34:16.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442025-01-09T01:34:16.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10452025-01-09T01:34:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10462025-01-09T01:34:16.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10472025-01-09T01:34:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10482025-01-09T01:34:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10492025-01-09T01:34:16.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10502025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10512025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10522025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10532025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10542025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10552025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10562025-01-09T01:34:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10572025-01-09T01:34:16.616ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
10582025-01-09T01:34:16.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.581747ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
10592025-01-09T01:34:16.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 989, tv_nsec: 21198082 } })
10602025-01-09T01:34:16.617ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10612025-01-09T01:34:16.617ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
10622025-01-09T01:34:16.617ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 15.888996ms iteration = 3 status = {"error":"rack not yet initialized: 59b29299-38cc-4366-91a5-ce2131096a5f"}
10632025-01-09T01:34:16.617ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 16.273862ms iteration = 2 status = {}
10642025-01-09T01:34:16.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10652025-01-09T01:34:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10662025-01-09T01:34:16.625ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10672025-01-09T01:34:16.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10682025-01-09T01:34:16.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10692025-01-09T01:34:16.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10702025-01-09T01:34:16.650ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 50.748437ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10712025-01-09T01:34:16.653ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10722025-01-09T01:34:16.653ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10732025-01-09T01:34:16.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10742025-01-09T01:34:16.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10752025-01-09T01:34:16.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.153961ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
10762025-01-09T01:34:16.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.328216ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
10772025-01-09T01:34:16.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10782025-01-09T01:34:16.660ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10792025-01-09T01:34:16.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802025-01-09T01:34:16.661ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a079b109-9925-44f3-bc40-fa40d16d10ed", "content-length": "26", "date": "Thu, 09 Jan 2025 01:34:16 GMT"} })
10812025-01-09T01:34:16.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10822025-01-09T01:34:16.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10832025-01-09T01:34:16.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10842025-01-09T01:34:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10852025-01-09T01:34:16.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10862025-01-09T01:34:16.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10872025-01-09T01:34:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10882025-01-09T01:34:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10892025-01-09T01:34:16.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10902025-01-09T01:34:16.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10912025-01-09T01:34:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10922025-01-09T01:34:16.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.308782ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10932025-01-09T01:34:16.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10942025-01-09T01:34:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10952025-01-09T01:34:16.667ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 65.89355ms iteration = 2 status = {}
10962025-01-09T01:34:16.667ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10972025-01-09T01:34:16.667ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.067893ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10982025-01-09T01:34:16.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.851892ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10992025-01-09T01:34:16.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.472108ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11002025-01-09T01:34:16.695ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11012025-01-09T01:34:16.695ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11022025-01-09T01:34:16.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11032025-01-09T01:34:16.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11042025-01-09T01:34:16.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11052025-01-09T01:34:16.713ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11062025-01-09T01:34:16.713ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3048f6a-69b0-4812-ad35-f860b52fc969", "content-length": "26", "date": "Thu, 09 Jan 2025 01:34:16 GMT"} })
11072025-01-09T01:34:16.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11082025-01-09T01:34:16.714ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11092025-01-09T01:34:16.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.729392ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11102025-01-09T01:34:16.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11112025-01-09T01:34:16.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11122025-01-09T01:34:16.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.580127ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11132025-01-09T01:34:16.747ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 147.867869ms iteration = 2 status = {}
11142025-01-09T01:34:16.762ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11152025-01-09T01:34:16.762ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b310f698-04df-4fd4-94d8-6913910d2402", "content-length": "1", "date": "Thu, 09 Jan 2025 01:34:16 GMT"} })
11162025-01-09T01:34:16.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11172025-01-09T01:34:16.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11182025-01-09T01:34:16.765ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 165.812708ms iteration = 2 status = null
11192025-01-09T01:34:16.771ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
11202025-01-09T01:34:16.771ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.690236ms iteration = 2 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
11212025-01-09T01:34:16.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11222025-01-09T01:34:16.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11232025-01-09T01:34:16.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242025-01-09T01:34:16.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11252025-01-09T01:34:16.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11262025-01-09T01:34:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11272025-01-09T01:34:16.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282025-01-09T01:34:16.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11292025-01-09T01:34:16.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11302025-01-09T01:34:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11312025-01-09T01:34:16.811ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 210.789041ms iteration = 2 status = {}
11322025-01-09T01:34:18.351ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11332025-01-09T01:34:18.351ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11342025-01-09T01:34:18.353ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11352025-01-09T01:34:18.353ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11362025-01-09T01:34:18.355ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372025-01-09T01:34:18.357ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
11382025-01-09T01:34:18.357ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11392025-01-09T01:34:20.358ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11402025-01-09T01:34:20.359ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11412025-01-09T01:34:20.360ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11422025-01-09T01:34:20.360ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11432025-01-09T01:34:20.362ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442025-01-09T01:34:20.364ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
11452025-01-09T01:34:20.364ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11462025-01-09T01:34:22.365ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11472025-01-09T01:34:22.366ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11482025-01-09T01:34:22.367ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11492025-01-09T01:34:22.367ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11502025-01-09T01:34:22.369ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512025-01-09T01:34:22.372ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
11522025-01-09T01:34:22.372ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11532025-01-09T01:34:22.626ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62957
11542025-01-09T01:34:22.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62957 req_id = 6b7df973-0879-4ee2-8beb-42ad6222916f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11552025-01-09T01:34:22.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62957 req_id = 6b7df973-0879-4ee2-8beb-42ad6222916f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11562025-01-09T01:34:22.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62957 req_id = 6b7df973-0879-4ee2-8beb-42ad6222916f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11572025-01-09T01:34:22.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62957 req_id = 563d905a-a475-488f-af12-f351f32226b1 roles = RoleSet { roles: {} } uri = /sled-agents/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11582025-01-09T01:34:22.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62957 req_id = 563d905a-a475-488f-af12-f351f32226b1 resource = Database result = Ok(()) uri = /sled-agents/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11592025-01-09T01:34:22.652ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "2a5ec8ce-31e5-4982-a156-7cc817b136d7" error_message_internal = not found: sled with id "2a5ec8ce-31e5-4982-a156-7cc817b136d7" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 3285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62957 req_id = 563d905a-a475-488f-af12-f351f32226b1 response_code = 404 uri = /sled-agents/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11602025-01-09T01:34:22.975ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45475
11612025-01-09T01:34:22.988ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:56 sled_uuid = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
11622025-01-09T01:34:23.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41643 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ba758310-4081-4618-b0e0-c130dfddf716 response_code = 204 uri = /sled-agents/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11632025-01-09T01:34:23.027ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
11642025-01-09T01:34:23.027ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11652025-01-09T01:34:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11662025-01-09T01:34:23.029ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672025-01-09T01:34:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
11682025-01-09T01:34:23.031ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11692025-01-09T01:34:23.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11702025-01-09T01:34:23.041ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(2042c7d1-dda3-4a79-8fe3-7040faeae11f, 0), (055d2ccc-e04f-4dc7-9a18-2ea9cfbf42b1, 0), (d4ab9d57-bb00-41fe-8442-0315c7800b81, 0)]
11712025-01-09T01:34:23.042ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 995, tv_nsec: 446449778 } })
11722025-01-09T01:34:23.074ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
11732025-01-09T01:34:23.074ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
11742025-01-09T01:34:23.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
11752025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe48ddd0-e852-4105-acdf-169c4899b48b", "content-length": "476", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11762025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
11772025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e1caf19-01ec-440b-8ace-0012c160e7ad", "content-length": "734", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11782025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
11792025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e31e02f5-0307-4443-9976-8350707a294b", "content-length": "111", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11802025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
11812025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "717d9f5a-8ed7-4392-a102-6df730187c12", "content-length": "111", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11822025-01-09T01:34:23.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
11832025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "097229ae-eeb8-4320-9b0d-0cf4166f0140", "content-length": "167", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11842025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
11852025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce1af79-1e42-4e1d-a735-273adf154cb0", "content-length": "167", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11862025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
11872025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a9a2389-6ecc-47b2-b22c-d647c329211a", "content-length": "175", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11882025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
11892025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0ff96d-f16d-4789-bfc7-506001653e7a", "content-length": "175", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11902025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
11912025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a923cd6-52fa-46c8-8758-e1eb18d8bc90", "content-length": "702", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11922025-01-09T01:34:23.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11932025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a464541d-04d5-48f7-a9fa-d1cc492aa0c9", "content-length": "727", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11942025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11952025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "89eb2a25-0cb1-43b4-8a7c-2594e468698a", "content-length": "729", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11962025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11972025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3ce071b-39ae-4391-beb8-aa21833df732", "content-length": "728", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
11982025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
11992025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8347dffb-95e1-432b-a060-cf0298b4bfcf", "content-length": "722", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12002025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
12012025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "91cb4e61-3694-4950-aab8-93a86c233b57", "content-length": "109", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12022025-01-09T01:34:23.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
12032025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bb3bab8-a03b-4515-8e89-0e71465d7a42", "content-length": "109", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12042025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
12052025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d3e9fc1-fb72-4217-a218-ac3ba2f47422", "content-length": "169", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12062025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
12072025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7089f89-de74-491b-9155-633df0087235", "content-length": "169", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12082025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
12092025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "34cc262c-e4b0-48a7-b3d1-d71bde5f3334", "content-length": "178", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12102025-01-09T01:34:23.078ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
12112025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f455df69-9193-459d-bd84-594e02c6269e", "content-length": "178", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12122025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
12132025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "13c60bb9-abb2-41ab-b3cb-93434380b27d", "content-length": "702", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12142025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12152025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b3a3638-3ce1-4a4c-9dca-21157c19199b", "content-length": "727", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12162025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12172025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "63f58ed6-7cae-43b7-ae77-228651dbe781", "content-length": "729", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12182025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12192025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "59b6538b-403b-4f43-87c1-35b5c1bfc1d7", "content-length": "728", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12202025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12212025-01-09T01:34:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12222025-01-09T01:34:23.081ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232025-01-09T01:34:23.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
12242025-01-09T01:34:23.083ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12252025-01-09T01:34:23.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12262025-01-09T01:34:23.085ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12272025-01-09T01:34:23.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
12282025-01-09T01:34:23.087ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12292025-01-09T01:34:23.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12302025-01-09T01:34:23.121ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
12312025-01-09T01:34:23.121ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
12322025-01-09T01:34:23.331ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4309dc21-829b-4acb-8f38-a62a1178a08f", "content-length": "30788", "date": "Thu, 09 Jan 2025 01:34:23 GMT"} })
12332025-01-09T01:34:23.333ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
12342025-01-09T01:34:23.333ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
12352025-01-09T01:34:23.333ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
12362025-01-09T01:34:23.334ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12372025-01-09T01:34:23.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12382025-01-09T01:34:23.336ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392025-01-09T01:34:23.338ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
12402025-01-09T01:34:23.338ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12412025-01-09T01:34:23.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12422025-01-09T01:34:23.498ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f30db307-4006-41e7-9006-c79be6922e93 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
12432025-01-09T01:34:23.498ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f30db307-4006-41e7-9006-c79be6922e93 time_started = 2025-01-09 01:34:23.074518 UTC
12442025-01-09T01:34:23.498ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 470.756263ms iteration = 2 status = {"collection_id":"f30db307-4006-41e7-9006-c79be6922e93","time_done":"2025-01-09 01:34:23.333587 UTC","time_started":"2025-01-09 01:34:23.074518 UTC"}
12452025-01-09T01:34:23.498ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
12462025-01-09T01:34:23.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12472025-01-09T01:34:23.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12482025-01-09T01:34:23.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492025-01-09T01:34:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12502025-01-09T01:34:23.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12512025-01-09T01:34:23.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12522025-01-09T01:34:23.504ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
12532025-01-09T01:34:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.066307ms iteration = 4 status = {"error":"rack not yet initialized: 59b29299-38cc-4366-91a5-ce2131096a5f"}
12542025-01-09T01:34:23.526ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50896
12552025-01-09T01:34:23.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 98177d00-326a-43d7-af9a-77d0a4b89118 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12562025-01-09T01:34:23.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 98177d00-326a-43d7-af9a-77d0a4b89118 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12572025-01-09T01:34:23.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 98177d00-326a-43d7-af9a-77d0a4b89118 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12582025-01-09T01:34:23.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fee95aaa-5276-4218-a6a0-49e62439114e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12592025-01-09T01:34:23.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fee95aaa-5276-4218-a6a0-49e62439114e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12602025-01-09T01:34:23.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fee95aaa-5276-4218-a6a0-49e62439114e response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12612025-01-09T01:34:23.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 53dd997d-bd14-4b84-9c3d-c48f39e4a626 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12622025-01-09T01:34:23.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 53dd997d-bd14-4b84-9c3d-c48f39e4a626 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12632025-01-09T01:34:23.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 53dd997d-bd14-4b84-9c3d-c48f39e4a626 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12642025-01-09T01:34:23.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 03eb6edd-f8cc-43b6-ab58-f79d3f134a57 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12652025-01-09T01:34:23.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 03eb6edd-f8cc-43b6-ab58-f79d3f134a57 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12662025-01-09T01:34:23.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 03eb6edd-f8cc-43b6-ab58-f79d3f134a57 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12672025-01-09T01:34:23.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3bdd17cb-7c2f-4cd1-8581-0dd00a6e7892 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12682025-01-09T01:34:23.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3bdd17cb-7c2f-4cd1-8581-0dd00a6e7892 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12692025-01-09T01:34:23.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3bdd17cb-7c2f-4cd1-8581-0dd00a6e7892 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12702025-01-09T01:34:23.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 599f2b04-608d-4122-a101-ad4fc99ac13b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12712025-01-09T01:34:23.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 599f2b04-608d-4122-a101-ad4fc99ac13b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12722025-01-09T01:34:23.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 599f2b04-608d-4122-a101-ad4fc99ac13b response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12732025-01-09T01:34:23.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 53051366-98ca-40f7-8d25-0d938bdee68d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12742025-01-09T01:34:23.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 53051366-98ca-40f7-8d25-0d938bdee68d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12752025-01-09T01:34:23.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 53051366-98ca-40f7-8d25-0d938bdee68d response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12762025-01-09T01:34:23.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 48671184-2dd4-4196-9a06-88727a01b7de roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12772025-01-09T01:34:23.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 48671184-2dd4-4196-9a06-88727a01b7de resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12782025-01-09T01:34:23.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 48671184-2dd4-4196-9a06-88727a01b7de response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12792025-01-09T01:34:24.373ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12802025-01-09T01:34:24.373ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12812025-01-09T01:34:24.375ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12822025-01-09T01:34:24.375ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12832025-01-09T01:34:24.377ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12842025-01-09T01:34:24.379ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
12852025-01-09T01:34:24.379ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12862025-01-09T01:34:24.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe35dbc1-18ef-4554-b8f0-f6bbd7993e05 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12872025-01-09T01:34:24.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe35dbc1-18ef-4554-b8f0-f6bbd7993e05 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12882025-01-09T01:34:24.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe35dbc1-18ef-4554-b8f0-f6bbd7993e05 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12892025-01-09T01:34:25.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a2cb605d-df71-4e40-a2a3-e035267f57c8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12902025-01-09T01:34:25.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a2cb605d-df71-4e40-a2a3-e035267f57c8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12912025-01-09T01:34:25.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a2cb605d-df71-4e40-a2a3-e035267f57c8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12922025-01-09T01:34:26.381ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12932025-01-09T01:34:26.381ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12942025-01-09T01:34:26.383ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12952025-01-09T01:34:26.383ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12962025-01-09T01:34:26.384ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972025-01-09T01:34:26.387ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
12982025-01-09T01:34:26.387ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12992025-01-09T01:34:26.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
13002025-01-09T01:34:26.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13012025-01-09T01:34:26.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13022025-01-09T01:34:26.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
13032025-01-09T01:34:26.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13042025-01-09T01:34:26.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13052025-01-09T01:34:26.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13062025-01-09T01:34:26.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13072025-01-09T01:34:26.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13082025-01-09T01:34:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13092025-01-09T01:34:26.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13102025-01-09T01:34:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13112025-01-09T01:34:26.607ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
13122025-01-09T01:34:26.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.176696ms iteration = 5 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
13132025-01-09T01:34:26.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.005239ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13142025-01-09T01:34:26.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6aa2422-c3b0-435c-8e7b-58cdedb7dff6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13152025-01-09T01:34:26.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6aa2422-c3b0-435c-8e7b-58cdedb7dff6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13162025-01-09T01:34:26.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6aa2422-c3b0-435c-8e7b-58cdedb7dff6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13172025-01-09T01:34:27.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 972b9a74-870d-42cd-b35d-7a4a5b113914 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13182025-01-09T01:34:27.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 972b9a74-870d-42cd-b35d-7a4a5b113914 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13192025-01-09T01:34:27.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 972b9a74-870d-42cd-b35d-7a4a5b113914 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13202025-01-09T01:34:28.388ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13212025-01-09T01:34:28.388ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13222025-01-09T01:34:28.390ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13232025-01-09T01:34:28.390ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13242025-01-09T01:34:28.391ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252025-01-09T01:34:28.393ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
13262025-01-09T01:34:28.393ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13272025-01-09T01:34:28.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eb4c0f2d-b0be-4bf4-b2ff-4bec57b36a84 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13282025-01-09T01:34:28.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eb4c0f2d-b0be-4bf4-b2ff-4bec57b36a84 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13292025-01-09T01:34:28.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eb4c0f2d-b0be-4bf4-b2ff-4bec57b36a84 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13302025-01-09T01:34:29.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a731976b-0916-4a7f-b64a-09e8bb857f72 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13312025-01-09T01:34:29.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a731976b-0916-4a7f-b64a-09e8bb857f72 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13322025-01-09T01:34:29.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a731976b-0916-4a7f-b64a-09e8bb857f72 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13332025-01-09T01:34:29.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45c80a87-4d79-4d6d-85dd-bef80e9cfa7f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13342025-01-09T01:34:29.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45c80a87-4d79-4d6d-85dd-bef80e9cfa7f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13352025-01-09T01:34:29.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45c80a87-4d79-4d6d-85dd-bef80e9cfa7f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13362025-01-09T01:34:30.395ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13372025-01-09T01:34:30.395ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13382025-01-09T01:34:30.396ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13392025-01-09T01:34:30.397ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13402025-01-09T01:34:30.398ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13412025-01-09T01:34:30.400ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
13422025-01-09T01:34:30.400ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 59b29299-38cc-4366-91a5-ce2131096a5f, time_created: 2025-01-09T01:33:46.555895Z, time_modified: 2025-01-09T01:33:46.555895Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13432025-01-09T01:34:30.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1662092-126a-41cc-8e70-f2d734ef25ba roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13442025-01-09T01:34:30.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1662092-126a-41cc-8e70-f2d734ef25ba resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13452025-01-09T01:34:30.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1662092-126a-41cc-8e70-f2d734ef25ba response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13462025-01-09T01:34:31.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fc232d8e-52c3-43f0-8d12-07b0e72396a6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13472025-01-09T01:34:31.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fc232d8e-52c3-43f0-8d12-07b0e72396a6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13482025-01-09T01:34:31.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fc232d8e-52c3-43f0-8d12-07b0e72396a6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13492025-01-09T01:34:32.402ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13502025-01-09T01:34:32.402ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13512025-01-09T01:34:32.404ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13522025-01-09T01:34:32.404ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13532025-01-09T01:34:32.405ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13542025-01-09T01:34:32.408ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 59b29299-38cc-4366-91a5-ce2131096a5f, lookup_type: ById(59b29299-38cc-4366-91a5-ce2131096a5f) } result = Ok(())
13552025-01-09T01:34:32.408ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
13562025-01-09T01:34:32.408ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13572025-01-09T01:34:32.408ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13582025-01-09T01:34:32.410ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13592025-01-09T01:34:32.410ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13602025-01-09T01:34:32.411ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13612025-01-09T01:34:32.411ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13622025-01-09T01:34:32.414ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13632025-01-09T01:34:32.415ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13642025-01-09T01:34:32.416ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13652025-01-09T01:34:32.416ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13662025-01-09T01:34:32.417ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13672025-01-09T01:34:32.418ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13682025-01-09T01:34:32.419ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692025-01-09T01:34:32.422ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13702025-01-09T01:34:32.422ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13712025-01-09T01:34:32.422ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13722025-01-09T01:34:32.424ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13732025-01-09T01:34:32.424ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13742025-01-09T01:34:32.425ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13752025-01-09T01:34:32.425ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13762025-01-09T01:34:32.427ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772025-01-09T01:34:32.430ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13782025-01-09T01:34:32.430ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13792025-01-09T01:34:32.430ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13802025-01-09T01:34:32.437ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13812025-01-09T01:34:32.437ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13822025-01-09T01:34:32.438ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13832025-01-09T01:34:32.438ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13842025-01-09T01:34:32.440ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13852025-01-09T01:34:32.440ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13862025-01-09T01:34:32.441ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13872025-01-09T01:34:32.441ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13882025-01-09T01:34:32.443ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13892025-01-09T01:34:32.443ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13902025-01-09T01:34:32.444ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13912025-01-09T01:34:32.444ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13922025-01-09T01:34:32.445ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932025-01-09T01:34:32.448ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13942025-01-09T01:34:32.450ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13952025-01-09T01:34:32.450ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13962025-01-09T01:34:32.451ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13972025-01-09T01:34:32.452ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13982025-01-09T01:34:32.453ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13992025-01-09T01:34:32.453ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14002025-01-09T01:34:32.455ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14012025-01-09T01:34:32.456ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14022025-01-09T01:34:32.458ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14032025-01-09T01:34:32.458ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14042025-01-09T01:34:32.459ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14052025-01-09T01:34:32.459ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14062025-01-09T01:34:32.460ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14072025-01-09T01:34:32.461ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14082025-01-09T01:34:32.462ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092025-01-09T01:34:32.465ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14102025-01-09T01:34:32.465ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14112025-01-09T01:34:32.466ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14122025-01-09T01:34:32.467ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14132025-01-09T01:34:32.467ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14142025-01-09T01:34:32.468ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14152025-01-09T01:34:32.468ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14162025-01-09T01:34:32.470ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172025-01-09T01:34:32.473ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14182025-01-09T01:34:32.473ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14192025-01-09T01:34:32.473ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14202025-01-09T01:34:32.479ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14212025-01-09T01:34:32.480ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14222025-01-09T01:34:32.481ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14232025-01-09T01:34:32.481ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14242025-01-09T01:34:32.483ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14252025-01-09T01:34:32.483ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14262025-01-09T01:34:32.485ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14272025-01-09T01:34:32.485ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14282025-01-09T01:34:32.486ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14292025-01-09T01:34:32.486ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14302025-01-09T01:34:32.488ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14312025-01-09T01:34:32.488ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14322025-01-09T01:34:32.489ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14332025-01-09T01:34:32.489ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14342025-01-09T01:34:32.491ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352025-01-09T01:34:32.494ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14362025-01-09T01:34:32.494ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14372025-01-09T01:34:32.494ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14382025-01-09T01:34:32.495ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14392025-01-09T01:34:32.495ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14402025-01-09T01:34:32.496ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14412025-01-09T01:34:32.497ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14422025-01-09T01:34:32.498ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432025-01-09T01:34:32.501ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14442025-01-09T01:34:32.501ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14452025-01-09T01:34:32.501ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14462025-01-09T01:34:32.509ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
14472025-01-09T01:34:32.509ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14482025-01-09T01:34:32.510ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14492025-01-09T01:34:32.511ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14502025-01-09T01:34:32.513ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
14512025-01-09T01:34:32.513ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14522025-01-09T01:34:32.513ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14532025-01-09T01:34:32.514ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
14542025-01-09T01:34:32.516ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
14552025-01-09T01:34:32.516ZDEBGnexus (InternalApi): resolved 2 rules for sleds
14562025-01-09T01:34:32.629ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, time_created: 2025-01-09T01:34:22.988660Z, time_modified: 2025-01-09T01:34:22.988660Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
14572025-01-09T01:34:32.630ZDEBGnexus (InternalApi): sending firewall rules to sled agents
14582025-01-09T01:34:32.630ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14592025-01-09T01:34:32.632ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14602025-01-09T01:34:32.634ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14612025-01-09T01:34:32.635ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14622025-01-09T01:34:32.636ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14632025-01-09T01:34:32.639ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
14642025-01-09T01:34:32.669ZDEBGnexus (InternalApi): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14652025-01-09T01:34:32.670ZDEBGnexus (InternalApi): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "55e5d001-2ac8-45c3-a032-137908654ff5", "date": "Thu, 09 Jan 2025 01:34:32 GMT"} })
14662025-01-09T01:34:32.670ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
14672025-01-09T01:34:32.670ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
14682025-01-09T01:34:32.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3fffdc66-fdc6-4653-bfd9-4c00edd26f35 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14692025-01-09T01:34:32.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3fffdc66-fdc6-4653-bfd9-4c00edd26f35 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14702025-01-09T01:34:32.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3fffdc66-fdc6-4653-bfd9-4c00edd26f35 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14712025-01-09T01:34:33.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d594e41d-5fe5-4785-9ca7-1f42413b3188 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14722025-01-09T01:34:33.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d594e41d-5fe5-4785-9ca7-1f42413b3188 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14732025-01-09T01:34:33.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d594e41d-5fe5-4785-9ca7-1f42413b3188 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14742025-01-09T01:34:34.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aeb7caa2-4041-46d0-ad32-d491822186b3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14752025-01-09T01:34:34.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aeb7caa2-4041-46d0-ad32-d491822186b3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14762025-01-09T01:34:34.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aeb7caa2-4041-46d0-ad32-d491822186b3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14772025-01-09T01:34:35.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01551438-a29d-4793-b519-591825e22c79 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14782025-01-09T01:34:35.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01551438-a29d-4793-b519-591825e22c79 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14792025-01-09T01:34:35.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01551438-a29d-4793-b519-591825e22c79 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
14802025-01-09T01:34:36.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
14812025-01-09T01:34:36.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14822025-01-09T01:34:36.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14832025-01-09T01:34:36.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
14842025-01-09T01:34:36.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14852025-01-09T01:34:36.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14862025-01-09T01:34:36.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14872025-01-09T01:34:36.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14882025-01-09T01:34:36.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14892025-01-09T01:34:36.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.66053ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14902025-01-09T01:34:36.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14912025-01-09T01:34:36.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14922025-01-09T01:34:36.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14932025-01-09T01:34:36.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14942025-01-09T01:34:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14952025-01-09T01:34:36.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962025-01-09T01:34:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
14972025-01-09T01:34:36.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14982025-01-09T01:34:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14992025-01-09T01:34:36.639ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
15002025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
15012025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.012947ms iteration = 6 status = {"enabled":false,"status":"first target blueprint","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z","time_found":"2025-01-09T01:34:36.639486645Z"}
15022025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
15032025-01-09T01:34:36.639ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
15042025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 5.98\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
15052025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15062025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15072025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15082025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15092025-01-09T01:34:36.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15102025-01-09T01:34:36.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15112025-01-09T01:34:36.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15122025-01-09T01:34:36.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15132025-01-09T01:34:36.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15142025-01-09T01:34:36.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15152025-01-09T01:34:36.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15162025-01-09T01:34:36.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15172025-01-09T01:34:36.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15182025-01-09T01:34:36.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15192025-01-09T01:34:36.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202025-01-09T01:34:36.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15212025-01-09T01:34:36.646ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15222025-01-09T01:34:36.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15232025-01-09T01:34:36.646ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15242025-01-09T01:34:36.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15252025-01-09T01:34:36.648ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15262025-01-09T01:34:36.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15272025-01-09T01:34:36.648ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15282025-01-09T01:34:36.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15292025-01-09T01:34:36.651ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15302025-01-09T01:34:36.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15312025-01-09T01:34:36.689ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
15322025-01-09T01:34:36.722ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
15332025-01-09T01:34:36.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342025-01-09T01:34:36.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15352025-01-09T01:34:36.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15362025-01-09T01:34:36.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15372025-01-09T01:34:36.783ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
15382025-01-09T01:34:36.815ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
15392025-01-09T01:34:36.850ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
15402025-01-09T01:34:36.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f043469e-0614-4dcf-a47f-98a0d22a7922 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15412025-01-09T01:34:36.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f043469e-0614-4dcf-a47f-98a0d22a7922 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15422025-01-09T01:34:36.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f043469e-0614-4dcf-a47f-98a0d22a7922 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15432025-01-09T01:34:37.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf865a51-9460-4f59-9d73-26f95a7e06da roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15442025-01-09T01:34:37.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf865a51-9460-4f59-9d73-26f95a7e06da resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15452025-01-09T01:34:37.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf865a51-9460-4f59-9d73-26f95a7e06da response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15462025-01-09T01:34:38.881ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77147db5-4fd9-47ca-8172-4e1a9faec526", "content-length": "64", "date": "Thu, 09 Jan 2025 01:34:38 GMT"} })
15472025-01-09T01:34:38.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15482025-01-09T01:34:38.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15492025-01-09T01:34:38.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15502025-01-09T01:34:38.884ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15512025-01-09T01:34:38.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15522025-01-09T01:34:38.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15532025-01-09T01:34:38.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22b3d72b-1941-4c67-b454-7d0225be7cf6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15542025-01-09T01:34:38.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22b3d72b-1941-4c67-b454-7d0225be7cf6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15552025-01-09T01:34:38.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22b3d72b-1941-4c67-b454-7d0225be7cf6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15562025-01-09T01:34:39.014ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "858d62ab-55b1-4589-9b85-f64da6ef6f65", "content-length": "64", "date": "Thu, 09 Jan 2025 01:34:39 GMT"} })
15572025-01-09T01:34:39.014ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15582025-01-09T01:34:39.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15592025-01-09T01:34:39.016ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15602025-01-09T01:34:39.018ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15612025-01-09T01:34:39.018ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15622025-01-09T01:34:39.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15632025-01-09T01:34:40.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = df094f4b-892b-4268-a1f5-477e3bd22065 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15642025-01-09T01:34:40.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = df094f4b-892b-4268-a1f5-477e3bd22065 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15652025-01-09T01:34:40.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = df094f4b-892b-4268-a1f5-477e3bd22065 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15662025-01-09T01:34:40.024ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "317ee31d-589a-4787-8a35-346070b69cab", "content-length": "64", "date": "Thu, 09 Jan 2025 01:34:40 GMT"} })
15672025-01-09T01:34:40.024ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15682025-01-09T01:34:40.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15692025-01-09T01:34:40.026ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702025-01-09T01:34:40.028ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15712025-01-09T01:34:40.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15722025-01-09T01:34:40.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15732025-01-09T01:34:41.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9b13699-b923-4c2c-963d-31d0f2ff8a6d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15742025-01-09T01:34:41.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9b13699-b923-4c2c-963d-31d0f2ff8a6d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15752025-01-09T01:34:41.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9b13699-b923-4c2c-963d-31d0f2ff8a6d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15762025-01-09T01:34:42.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 910c2274-8bd4-413b-95e6-8665d99a3d40 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15772025-01-09T01:34:42.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 910c2274-8bd4-413b-95e6-8665d99a3d40 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15782025-01-09T01:34:42.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 910c2274-8bd4-413b-95e6-8665d99a3d40 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15792025-01-09T01:34:43.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = adad793b-72a5-41f2-a442-0d5628b0e65f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15802025-01-09T01:34:43.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = adad793b-72a5-41f2-a442-0d5628b0e65f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15812025-01-09T01:34:43.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = adad793b-72a5-41f2-a442-0d5628b0e65f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15822025-01-09T01:34:44.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f8bdea4-7007-421e-8ac1-35ae28521d14 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15832025-01-09T01:34:44.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f8bdea4-7007-421e-8ac1-35ae28521d14 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15842025-01-09T01:34:44.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f8bdea4-7007-421e-8ac1-35ae28521d14 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15852025-01-09T01:34:44.148ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97c273c-4d3e-452f-93ce-e191db05fd0d", "content-length": "64", "date": "Thu, 09 Jan 2025 01:34:44 GMT"} })
15862025-01-09T01:34:44.148ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15872025-01-09T01:34:44.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15882025-01-09T01:34:44.151ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892025-01-09T01:34:44.153ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15902025-01-09T01:34:44.153ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15912025-01-09T01:34:44.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15922025-01-09T01:34:44.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 144104e6-24d0-420e-9224-35e79893fcb0 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
15932025-01-09T01:34:44.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 144104e6-24d0-420e-9224-35e79893fcb0 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
15942025-01-09T01:34:44.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 144104e6-24d0-420e-9224-35e79893fcb0 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
15952025-01-09T01:34:44.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = ff71a452-240b-418a-913f-a314cc1f6cf5 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
15962025-01-09T01:34:44.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = ff71a452-240b-418a-913f-a314cc1f6cf5 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
15972025-01-09T01:34:44.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = ff71a452-240b-418a-913f-a314cc1f6cf5 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
15982025-01-09T01:34:45.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 625faa6b-c68b-43ad-8fc8-6fe7cbb966ae roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15992025-01-09T01:34:45.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 625faa6b-c68b-43ad-8fc8-6fe7cbb966ae resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16002025-01-09T01:34:45.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 625faa6b-c68b-43ad-8fc8-6fe7cbb966ae response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16012025-01-09T01:34:46.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e670006c-66db-4fb2-aa3c-4b94b8053ef4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16022025-01-09T01:34:46.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e670006c-66db-4fb2-aa3c-4b94b8053ef4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16032025-01-09T01:34:46.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e670006c-66db-4fb2-aa3c-4b94b8053ef4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16042025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16052025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16062025-01-09T01:34:46.599ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16072025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16082025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16092025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 17.411\u{b5}s iteration = 3 status = {"error":"no config"}
16102025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16112025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16122025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16132025-01-09T01:34:46.599ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16142025-01-09T01:34:46.599ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16152025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 15.41\u{b5}s iteration = 3 status = {"error":"no config"}
16162025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
16172025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16182025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16192025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16202025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16212025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16222025-01-09T01:34:46.600ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:24:46.599966638 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16232025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16242025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
16252025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16262025-01-09T01:34:46.600ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
16272025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
16282025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16292025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
16302025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16312025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16322025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16332025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16342025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16352025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16362025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16372025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16382025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16392025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16402025-01-09T01:34:46.600ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1019, tv_nsec: 4883929 } })
16412025-01-09T01:34:46.600ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1019, tv_nsec: 4865669 } })
16422025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
16432025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16442025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
16452025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16462025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16472025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16482025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
16492025-01-09T01:34:46.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16502025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16512025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
16522025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
16532025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16542025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16552025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16562025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
16572025-01-09T01:34:46.600ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16582025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
16592025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16602025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16612025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
16622025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16632025-01-09T01:34:46.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
16642025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16652025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16662025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16672025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16682025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16692025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
16702025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16712025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.26232ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
16722025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16732025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16742025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16752025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16762025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
16772025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16782025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16792025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.379522ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
16802025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16812025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16822025-01-09T01:34:46.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16832025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
16842025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
16852025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
16862025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
16872025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16882025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16892025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16902025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
16912025-01-09T01:34:46.603ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:24:46.599966638 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
16922025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.282192ms iteration = 2 status = {"expiration":"2025-01-09T01:24:46.599966638Z","pruned":[]}
16932025-01-09T01:34:46.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1019, tv_nsec: 7437520 } })
16942025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16962025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16972025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
16982025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
16992025-01-09T01:34:46.603ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
17002025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17012025-01-09T01:34:46.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17022025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17032025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
17042025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17052025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
17062025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17072025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17082025-01-09T01:34:46.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1019, tv_nsec: 8955515 } })
17092025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17102025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17112025-01-09T01:34:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17122025-01-09T01:34:46.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
17132025-01-09T01:34:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17142025-01-09T01:34:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17152025-01-09T01:34:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17162025-01-09T01:34:46.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17172025-01-09T01:34:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17182025-01-09T01:34:46.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17192025-01-09T01:34:46.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17202025-01-09T01:34:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17212025-01-09T01:34:46.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17222025-01-09T01:34:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17232025-01-09T01:34:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17242025-01-09T01:34:46.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17252025-01-09T01:34:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17262025-01-09T01:34:46.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17272025-01-09T01:34:46.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17282025-01-09T01:34:46.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17292025-01-09T01:34:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17302025-01-09T01:34:46.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17312025-01-09T01:34:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17322025-01-09T01:34:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17332025-01-09T01:34:46.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17342025-01-09T01:34:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17352025-01-09T01:34:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17362025-01-09T01:34:46.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17372025-01-09T01:34:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17382025-01-09T01:34:46.617ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.281559ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17392025-01-09T01:34:46.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17402025-01-09T01:34:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17412025-01-09T01:34:46.619ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17422025-01-09T01:34:46.619ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17432025-01-09T01:34:46.619ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.81727ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17442025-01-09T01:34:46.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17452025-01-09T01:34:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17462025-01-09T01:34:46.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472025-01-09T01:34:46.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17482025-01-09T01:34:46.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17492025-01-09T01:34:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17502025-01-09T01:34:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17512025-01-09T01:34:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17522025-01-09T01:34:46.626ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1019, tv_nsec: 30840407 } })
17532025-01-09T01:34:46.627ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17542025-01-09T01:34:46.627ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.046455ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17552025-01-09T01:34:46.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17562025-01-09T01:34:46.629ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
17572025-01-09T01:34:46.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17582025-01-09T01:34:46.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
17592025-01-09T01:34:46.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17602025-01-09T01:34:46.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17612025-01-09T01:34:46.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
17622025-01-09T01:34:46.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17632025-01-09T01:34:46.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17642025-01-09T01:34:46.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652025-01-09T01:34:46.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17662025-01-09T01:34:46.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17672025-01-09T01:34:46.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17682025-01-09T01:34:46.640ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17692025-01-09T01:34:46.640ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17702025-01-09T01:34:46.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17712025-01-09T01:34:46.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17722025-01-09T01:34:46.657ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17732025-01-09T01:34:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17742025-01-09T01:34:46.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.897083ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
17752025-01-09T01:34:46.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17762025-01-09T01:34:46.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17772025-01-09T01:34:46.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17782025-01-09T01:34:46.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17792025-01-09T01:34:46.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17802025-01-09T01:34:46.662ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17812025-01-09T01:34:46.663ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c5b4a6-bc43-4815-a40f-d3add4bd8ad2", "content-length": "26", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
17822025-01-09T01:34:46.663ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17832025-01-09T01:34:46.665ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17842025-01-09T01:34:46.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17852025-01-09T01:34:46.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17862025-01-09T01:34:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17872025-01-09T01:34:46.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17882025-01-09T01:34:46.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17892025-01-09T01:34:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17902025-01-09T01:34:46.670ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
17912025-01-09T01:34:46.670ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.986892ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
17922025-01-09T01:34:46.673ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17932025-01-09T01:34:46.673ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17942025-01-09T01:34:46.673ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.156581ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17952025-01-09T01:34:46.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962025-01-09T01:34:46.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17972025-01-09T01:34:46.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17982025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17992025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18002025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18012025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18022025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18032025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18042025-01-09T01:34:46.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.346261ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
18052025-01-09T01:34:46.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062025-01-09T01:34:46.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18072025-01-09T01:34:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18082025-01-09T01:34:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18092025-01-09T01:34:46.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18102025-01-09T01:34:46.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18112025-01-09T01:34:46.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18122025-01-09T01:34:46.687ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18132025-01-09T01:34:46.687ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c662aa81-51ed-4de4-accc-7f8f4c21968e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
18142025-01-09T01:34:46.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18152025-01-09T01:34:46.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.050904ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18162025-01-09T01:34:46.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18172025-01-09T01:34:46.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18182025-01-09T01:34:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18192025-01-09T01:34:46.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.814291ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18202025-01-09T01:34:46.713ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 113.108189ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18212025-01-09T01:34:46.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18222025-01-09T01:34:46.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18232025-01-09T01:34:46.722ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18242025-01-09T01:34:46.722ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18252025-01-09T01:34:46.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18262025-01-09T01:34:46.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18272025-01-09T01:34:46.741ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18282025-01-09T01:34:46.741ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18292025-01-09T01:34:46.741ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18302025-01-09T01:34:46.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18312025-01-09T01:34:46.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18322025-01-09T01:34:46.742ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18332025-01-09T01:34:46.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18342025-01-09T01:34:46.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352025-01-09T01:34:46.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 143.281105ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18362025-01-09T01:34:46.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18372025-01-09T01:34:46.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18382025-01-09T01:34:46.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18392025-01-09T01:34:46.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18402025-01-09T01:34:46.748ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18412025-01-09T01:34:46.748ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
18422025-01-09T01:34:46.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18432025-01-09T01:34:46.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18442025-01-09T01:34:46.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18452025-01-09T01:34:46.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18462025-01-09T01:34:46.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18472025-01-09T01:34:46.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18482025-01-09T01:34:46.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18492025-01-09T01:34:46.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18502025-01-09T01:34:46.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18512025-01-09T01:34:46.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
18522025-01-09T01:34:46.764ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18532025-01-09T01:34:46.765ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53c65bd2-3e62-486c-99d2-4e20a5a2a79e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
18542025-01-09T01:34:46.765ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18552025-01-09T01:34:46.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18562025-01-09T01:34:46.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18572025-01-09T01:34:46.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
18582025-01-09T01:34:46.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18592025-01-09T01:34:46.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18602025-01-09T01:34:46.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18612025-01-09T01:34:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
18622025-01-09T01:34:46.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18632025-01-09T01:34:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18642025-01-09T01:34:46.789ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18652025-01-09T01:34:46.790ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "982452c6-6e00-497f-8c38-d7e18ef68081", "content-length": "1", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
18662025-01-09T01:34:46.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18672025-01-09T01:34:46.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18682025-01-09T01:34:46.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18692025-01-09T01:34:46.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18702025-01-09T01:34:46.795ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
18712025-01-09T01:34:46.795ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18722025-01-09T01:34:46.795ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
18732025-01-09T01:34:46.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 195.913052ms iteration = 2 status = {"generation":2}
18742025-01-09T01:34:46.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
18752025-01-09T01:34:46.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.806377ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
18762025-01-09T01:34:46.805ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18772025-01-09T01:34:46.805ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18782025-01-09T01:34:46.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18792025-01-09T01:34:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18802025-01-09T01:34:46.806ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18812025-01-09T01:34:46.806ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18822025-01-09T01:34:46.806ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 206.113965ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18832025-01-09T01:34:46.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18842025-01-09T01:34:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18852025-01-09T01:34:46.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18862025-01-09T01:34:46.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18872025-01-09T01:34:46.822ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 222.637711ms iteration = 3 status = {}
18882025-01-09T01:34:46.826ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 225.810372ms iteration = 5 status = {"physical_disks_added":0}
18892025-01-09T01:34:46.860ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
18902025-01-09T01:34:46.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 259.22751ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18912025-01-09T01:34:46.866ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
18922025-01-09T01:34:46.866ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 266.191242ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18932025-01-09T01:34:46.890ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18942025-01-09T01:34:46.890ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18952025-01-09T01:34:46.890ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "35f7af5c-133d-4c98-9d57-084de4b3c7d6", "content-length": "372", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
18962025-01-09T01:34:46.891ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
18972025-01-09T01:34:46.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18982025-01-09T01:34:46.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18992025-01-09T01:34:46.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19002025-01-09T01:34:46.893ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.415671ms iteration = 3 status = null
19012025-01-09T01:34:46.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19022025-01-09T01:34:46.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19032025-01-09T01:34:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19042025-01-09T01:34:46.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19052025-01-09T01:34:46.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19062025-01-09T01:34:46.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19072025-01-09T01:34:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19082025-01-09T01:34:46.900ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
19092025-01-09T01:34:46.900ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19102025-01-09T01:34:46.900ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
19112025-01-09T01:34:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 300.658337ms iteration = 2 status = {"generation":1}
19122025-01-09T01:34:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
19132025-01-09T01:34:46.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19142025-01-09T01:34:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19152025-01-09T01:34:46.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19162025-01-09T01:34:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19172025-01-09T01:34:46.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19182025-01-09T01:34:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19192025-01-09T01:34:46.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19202025-01-09T01:34:46.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19212025-01-09T01:34:46.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19222025-01-09T01:34:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19232025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
19242025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
19252025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
19262025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
19272025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
19282025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
19292025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
19302025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
19312025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
19322025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
19332025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
19342025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
19352025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles versions = all
19362025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/system/support-bundles versions = all
19372025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
19382025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
19392025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
19402025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
19412025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
19422025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
19432025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
19442025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
19452025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
19462025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
19472025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
19482025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
19492025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
19502025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
19512025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
19522025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
19532025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
19542025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
19552025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
19562025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
19572025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
19582025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
19592025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
19602025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
19612025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
19622025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
19632025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
19642025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
19652025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
19662025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
19672025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
19682025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
19692025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
19702025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
19712025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
19722025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
19732025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
19742025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
19752025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
19762025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
19772025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
19782025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
19792025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
19802025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
19812025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
19822025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
19832025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
19842025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
19852025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
19862025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
19872025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
19882025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
19892025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
19902025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
19912025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
19922025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
19932025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19942025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19952025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
19962025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
19972025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
19982025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
19992025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
20002025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
20012025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
20022025-01-09T01:34:46.909ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
20032025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
20042025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
20052025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
20062025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
20072025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
20082025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
20092025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
20102025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
20112025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
20122025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
20132025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
20142025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
20152025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
20162025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
20172025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
20182025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
20192025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
20202025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
20212025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
20222025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
20232025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
20242025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
20252025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
20262025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
20272025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
20282025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
20292025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
20302025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
20312025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
20322025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
20332025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
20342025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
20352025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
20362025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
20372025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
20382025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
20392025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
20402025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
20412025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
20422025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
20432025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
20442025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
20452025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
20462025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
20472025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
20482025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
20492025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
20502025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
20512025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
20522025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
20532025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
20542025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
20552025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
20562025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
20572025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
20582025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
20592025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
20602025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
20612025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
20622025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
20632025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
20642025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
20652025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
20662025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
20672025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
20682025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
20692025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
20702025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
20712025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
20722025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
20732025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
20742025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
20752025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
20762025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
20772025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
20782025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
20792025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
20802025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
20812025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
20822025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
20832025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
20842025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
20852025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
20862025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
20872025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
20882025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
20892025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
20902025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
20912025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
20922025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
20932025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
20942025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
20952025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
20962025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
20972025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
20982025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
20992025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
21002025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
21012025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
21022025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
21032025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
21042025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
21052025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
21062025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
21072025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
21082025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
21092025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
21102025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
21112025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
21122025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
21132025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
21142025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
21152025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
21162025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
21172025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
21182025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
21192025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
21202025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
21212025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
21222025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
21232025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
21242025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
21252025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
21262025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
21272025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
21282025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
21292025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
21302025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
21312025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
21322025-01-09T01:34:46.910ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
21332025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
21342025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
21352025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
21362025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
21372025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
21382025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
21392025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
21402025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
21412025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
21422025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
21432025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
21442025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
21452025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
21462025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
21472025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
21482025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
21492025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
21502025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
21512025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
21522025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
21532025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
21542025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
21552025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
21562025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
21572025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
21582025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
21592025-01-09T01:34:46.911ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
21602025-01-09T01:34:46.911ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
21612025-01-09T01:34:46.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21622025-01-09T01:34:46.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21632025-01-09T01:34:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21642025-01-09T01:34:46.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21652025-01-09T01:34:46.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21662025-01-09T01:34:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21672025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
21682025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
21692025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
21702025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
21712025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
21722025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
21732025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
21742025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
21752025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
21762025-01-09T01:34:46.920ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
21772025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
21782025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
21792025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
21802025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
21812025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
21822025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
21832025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
21842025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
21852025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
21862025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
21872025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
21882025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
21892025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
21902025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
21912025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21922025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21932025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21942025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
21952025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
21962025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
21972025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
21982025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
21992025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
22002025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
22012025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
22022025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
22032025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
22042025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
22052025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
22062025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
22072025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
22082025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
22092025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
22102025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
22112025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
22122025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
22132025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
22142025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
22152025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
22162025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
22172025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
22182025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
22192025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
22202025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
22212025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
22222025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
22232025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
22242025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
22252025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
22262025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
22272025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
22282025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
22292025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
22302025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
22312025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
22322025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
22332025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
22342025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
22352025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
22362025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
22372025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22382025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22392025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
22402025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
22412025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
22422025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
22432025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
22442025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
22452025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
22462025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
22472025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
22482025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
22492025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
22502025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
22512025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
22522025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
22532025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
22542025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
22552025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
22562025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
22572025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
22582025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
22592025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
22602025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
22612025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
22622025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
22632025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
22642025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
22652025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
22662025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
22672025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
22682025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
22692025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
22702025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
22712025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
22722025-01-09T01:34:46.921ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
22732025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
22742025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
22752025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
22762025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
22772025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
22782025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
22792025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
22802025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
22812025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
22822025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
22832025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
22842025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
22852025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
22862025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
22872025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
22882025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
22892025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
22902025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
22912025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22922025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22932025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22942025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22952025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22962025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
22972025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22982025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22992025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
23002025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
23012025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
23022025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
23032025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
23042025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
23052025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
23062025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
23072025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
23082025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
23092025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
23102025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
23112025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
23122025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
23132025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
23142025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
23152025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
23162025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
23172025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
23182025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23192025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23202025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
23212025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
23222025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
23232025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
23242025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
23252025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
23262025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
23272025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
23282025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
23292025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
23302025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
23312025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
23322025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
23332025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
23342025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
23352025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
23362025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
23372025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
23382025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
23392025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
23402025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
23412025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
23422025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
23432025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
23442025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
23452025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
23462025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
23472025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
23482025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
23492025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
23502025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
23512025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
23522025-01-09T01:34:46.922ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
23532025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
23542025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
23552025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
23562025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
23572025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
23582025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
23592025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
23602025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
23612025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
23622025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
23632025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
23642025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
23652025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
23662025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
23672025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
23682025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
23692025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
23702025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
23712025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
23722025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
23732025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
23742025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
23752025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
23762025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
23772025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
23782025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
23792025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
23802025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
23812025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
23822025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
23832025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
23842025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
23852025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
23862025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
23872025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
23882025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
23892025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
23902025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
23912025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
23922025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
23932025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
23942025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
23952025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23962025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23972025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23982025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
23992025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
24002025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
24012025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
24022025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
24032025-01-09T01:34:46.923ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
24042025-01-09T01:34:46.923ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
24052025-01-09T01:34:46.923ZDEBGnexus (nexus-producer-server): registered DTrace probes
24062025-01-09T01:34:46.931ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:55235 method = GET path = /{producer_id} versions = all
24072025-01-09T01:34:46.932ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:55235
24082025-01-09T01:34:46.932ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:55235
24092025-01-09T01:34:46.932ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:55235
24102025-01-09T01:34:46.932ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
24112025-01-09T01:34:46.932ZDEBGnexus (nexus-producer-server): starting producer registration task
24122025-01-09T01:34:46.933ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:55235 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
24132025-01-09T01:34:46.933ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24142025-01-09T01:34:46.933ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24152025-01-09T01:34:46.939ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1019, tv_nsec: 344022475 } })
24162025-01-09T01:34:46.940ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
24172025-01-09T01:34:46.975ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24182025-01-09T01:34:46.975ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24192025-01-09T01:34:46.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cc6a306a-c9d3-46a7-a609-481a045c4f5b", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24202025-01-09T01:34:46.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24212025-01-09T01:34:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24222025-01-09T01:34:46.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24232025-01-09T01:34:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24242025-01-09T01:34:46.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24252025-01-09T01:34:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24262025-01-09T01:34:46.993ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24272025-01-09T01:34:46.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24282025-01-09T01:34:46.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5b3fb810-f095-4ad0-aec6-187a265c8eb8", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24292025-01-09T01:34:46.995ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.683399ms iteration = 3 status = {}
24302025-01-09T01:34:47.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24312025-01-09T01:34:47.081ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "12a5f62d-3e16-428c-bd56-1c713c0fe338", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24322025-01-09T01:34:47.081ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24332025-01-09T01:34:47.083ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1bd78c42-db2a-41ab-9d51-ddab52544c7e", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24342025-01-09T01:34:47.083ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24352025-01-09T01:34:47.086ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24362025-01-09T01:34:47.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 290.823408ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24372025-01-09T01:34:47.100ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24382025-01-09T01:34:47.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24392025-01-09T01:34:47.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24402025-01-09T01:34:47.107ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
24412025-01-09T01:34:47.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24422025-01-09T01:34:47.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24432025-01-09T01:34:47.112ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24442025-01-09T01:34:47.112ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52402
24452025-01-09T01:34:47.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52402 req_id = 14f6a2d6-ebee-4f54-938e-4626b5f35c73 roles = RoleSet { roles: {} } uri = /metrics/producers
24462025-01-09T01:34:47.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52402 req_id = 14f6a2d6-ebee-4f54-938e-4626b5f35c73 resource = Database result = Ok(()) uri = /metrics/producers
24472025-01-09T01:34:47.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24482025-01-09T01:34:47.134ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e32414f-8a16-46bf-a966-017214602626", "content-length": "134", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24492025-01-09T01:34:47.134ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24502025-01-09T01:34:47.134ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
24512025-01-09T01:34:47.139ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24522025-01-09T01:34:47.139ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24532025-01-09T01:34:47.139ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24542025-01-09T01:34:47.139ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24552025-01-09T01:34:47.139ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24562025-01-09T01:34:47.139ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24572025-01-09T01:34:47.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24582025-01-09T01:34:47.148ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24592025-01-09T01:34:47.148ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9fda310-0425-4545-8f3e-73aa0619884c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24602025-01-09T01:34:47.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24612025-01-09T01:34:47.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24622025-01-09T01:34:47.150ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24632025-01-09T01:34:47.150ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24642025-01-09T01:34:47.151ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
24652025-01-09T01:34:47.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24662025-01-09T01:34:47.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24672025-01-09T01:34:47.155ZINFOnexus: assigned collector to new producer collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:76 producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
24682025-01-09T01:34:47.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43174 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52402 req_id = 14f6a2d6-ebee-4f54-938e-4626b5f35c73 response_code = 201 uri = /metrics/producers
24692025-01-09T01:34:47.155ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "14f6a2d6-ebee-4f54-938e-4626b5f35c73", "content-length": "41", "date": "Thu, 09 Jan 2025 01:34:47 GMT"} })
24702025-01-09T01:34:47.157ZDEBGnexus (producer-registration-task): registered with nexus successfully
24712025-01-09T01:34:47.157ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24722025-01-09T01:34:47.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24732025-01-09T01:34:47.163ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a47d9e5f-7c6b-409f-9900-a70730aaa71c", "content-length": "2", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24742025-01-09T01:34:47.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24752025-01-09T01:34:47.163ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "77832585-621b-4321-8902-10588a6b4954", "content-length": "52", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24762025-01-09T01:34:47.163ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
24772025-01-09T01:34:47.166ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24782025-01-09T01:34:47.237ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24792025-01-09T01:34:47.244ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
24802025-01-09T01:34:47.245ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce665d90-9435-4a57-8a11-510d22f898d9", "content-length": "4", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24812025-01-09T01:34:47.246ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 645.430312ms iteration = 3 status = 5
24822025-01-09T01:34:47.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24832025-01-09T01:34:47.283ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24842025-01-09T01:34:47.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "471d2a28-7fda-450e-83f0-1ab57dfa8efd", "date": "Thu, 09 Jan 2025 01:34:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24852025-01-09T01:34:47.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24862025-01-09T01:34:47.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eb80307d-57de-4627-86d6-2e074c1e350a", "date": "Thu, 09 Jan 2025 01:34:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24872025-01-09T01:34:47.286ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24882025-01-09T01:34:47.288ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bb998b76-5737-4ce1-a791-14db355dd669", "date": "Thu, 09 Jan 2025 01:34:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24892025-01-09T01:34:47.288ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24902025-01-09T01:34:47.289ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
24912025-01-09T01:34:47.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 389.321753ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24922025-01-09T01:34:47.321ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d7095cd-c723-40e9-b49c-d7150b1e5c11", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24932025-01-09T01:34:47.321ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
24942025-01-09T01:34:47.323ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24952025-01-09T01:34:47.323ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f34fc1b9-0232-4bbd-b2d6-b1526641aadd", "content-length": "691", "date": "Thu, 09 Jan 2025 01:34:46 GMT"} })
24962025-01-09T01:34:47.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8e290799-3db0-48af-957f-9c42ee0588ee roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24972025-01-09T01:34:47.323ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24982025-01-09T01:34:47.323ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24992025-01-09T01:34:47.323ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25002025-01-09T01:34:47.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8e290799-3db0-48af-957f-9c42ee0588ee resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25012025-01-09T01:34:47.325ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 724.651237ms iteration = 3 status = {}
25022025-01-09T01:34:47.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8e290799-3db0-48af-957f-9c42ee0588ee response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25032025-01-09T01:34:47.328ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "15b76275-0ece-4dce-ab27-95c3f9391bd4", "content-length": "539", "date": "Thu, 09 Jan 2025 01:34:47 GMT"} })
25042025-01-09T01:34:47.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25052025-01-09T01:34:47.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25062025-01-09T01:34:47.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25072025-01-09T01:34:47.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25082025-01-09T01:34:47.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25092025-01-09T01:34:47.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25102025-01-09T01:34:47.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25112025-01-09T01:34:47.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25122025-01-09T01:34:47.355ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
25132025-01-09T01:34:47.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25142025-01-09T01:34:47.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25152025-01-09T01:34:47.483ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
25162025-01-09T01:34:47.483ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25172025-01-09T01:34:47.488ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "f465735f-5b83-4954-824f-d2847b1a4c43", "date": "Thu, 09 Jan 2025 01:34:47 GMT"} })
25182025-01-09T01:34:47.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25192025-01-09T01:34:47.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25202025-01-09T01:34:47.500ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 899.143984ms iteration = 3 status = {}
25212025-01-09T01:34:47.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a278df8e-9a76-4c49-9a51-b627e2d6e69f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
25222025-01-09T01:34:47.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a278df8e-9a76-4c49-9a51-b627e2d6e69f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
25232025-01-09T01:34:47.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a278df8e-9a76-4c49-9a51-b627e2d6e69f response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
25242025-01-09T01:34:47.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9d92ee1f-0a2c-498d-8610-ec8a75b6f538 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
25252025-01-09T01:34:47.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9d92ee1f-0a2c-498d-8610-ec8a75b6f538 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
25262025-01-09T01:34:47.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9d92ee1f-0a2c-498d-8610-ec8a75b6f538 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
25272025-01-09T01:34:48.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d38401bd-67fb-4627-8cd8-75d20b2bfd70 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25282025-01-09T01:34:48.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d38401bd-67fb-4627-8cd8-75d20b2bfd70 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25292025-01-09T01:34:48.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d38401bd-67fb-4627-8cd8-75d20b2bfd70 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25302025-01-09T01:34:49.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = edc1bb49-d4c8-448a-9db0-d636f064f989 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25312025-01-09T01:34:49.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = edc1bb49-d4c8-448a-9db0-d636f064f989 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25322025-01-09T01:34:49.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = edc1bb49-d4c8-448a-9db0-d636f064f989 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25332025-01-09T01:34:50.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 37a847b7-fccc-4b2d-87bc-f572d0bd3b3d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25342025-01-09T01:34:50.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 37a847b7-fccc-4b2d-87bc-f572d0bd3b3d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25352025-01-09T01:34:50.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 37a847b7-fccc-4b2d-87bc-f572d0bd3b3d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25362025-01-09T01:34:51.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b292fea-29bf-4dd7-b9ee-603517dc5dba roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25372025-01-09T01:34:51.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b292fea-29bf-4dd7-b9ee-603517dc5dba resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25382025-01-09T01:34:51.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b292fea-29bf-4dd7-b9ee-603517dc5dba response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25392025-01-09T01:34:51.690ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::5]:32222/node/id", source: TimedOut })
25402025-01-09T01:34:51.698ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.059015879s iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone 51674af7-c107-40dc-95d4-4e5d6a25c76f at http://[fd00:1122:3344:101::5]:32222: Communication Error: error sending request for url (http://[fd00:1122:3344:101::5]:32222/node/id): error sending request for url (http://[fd00:1122:3344:101::5]:32222/node/id): operation timed out","zone_id":"51674af7-c107-40dc-95d4-4e5d6a25c76f"}],"nsuccess":4}
25412025-01-09T01:34:52.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7d44b289-11a7-49ee-9fa5-798c1cc774da roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25422025-01-09T01:34:52.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7d44b289-11a7-49ee-9fa5-798c1cc774da resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25432025-01-09T01:34:52.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7d44b289-11a7-49ee-9fa5-798c1cc774da response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25442025-01-09T01:34:53.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75e5408f-e6ff-4ca0-b3cf-9aa2bcdd5319 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25452025-01-09T01:34:53.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75e5408f-e6ff-4ca0-b3cf-9aa2bcdd5319 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25462025-01-09T01:34:53.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75e5408f-e6ff-4ca0-b3cf-9aa2bcdd5319 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25472025-01-09T01:34:54.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e16038af-89c0-4042-ad30-6999ab703967 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25482025-01-09T01:34:54.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e16038af-89c0-4042-ad30-6999ab703967 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25492025-01-09T01:34:54.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e16038af-89c0-4042-ad30-6999ab703967 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25502025-01-09T01:34:55.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 57529f78-acc6-469e-9f5e-3c4be8e83170 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25512025-01-09T01:34:55.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 57529f78-acc6-469e-9f5e-3c4be8e83170 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25522025-01-09T01:34:55.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 57529f78-acc6-469e-9f5e-3c4be8e83170 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25532025-01-09T01:34:56.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f26fe027-bda6-4552-82f9-eee30603b230 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25542025-01-09T01:34:56.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f26fe027-bda6-4552-82f9-eee30603b230 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25552025-01-09T01:34:56.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f26fe027-bda6-4552-82f9-eee30603b230 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25562025-01-09T01:34:56.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
25572025-01-09T01:34:56.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25582025-01-09T01:34:56.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25592025-01-09T01:34:56.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
25602025-01-09T01:34:56.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25612025-01-09T01:34:56.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25622025-01-09T01:34:56.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25632025-01-09T01:34:56.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25642025-01-09T01:34:56.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25652025-01-09T01:34:56.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25662025-01-09T01:34:56.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25672025-01-09T01:34:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25682025-01-09T01:34:56.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25692025-01-09T01:34:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25702025-01-09T01:34:56.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25712025-01-09T01:34:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
25722025-01-09T01:34:56.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25732025-01-09T01:34:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25742025-01-09T01:34:56.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
25752025-01-09T01:34:56.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.184951ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
25762025-01-09T01:34:56.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.737903ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25772025-01-09T01:34:57.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b9965ed-4797-498f-b5d1-4dbe4bc8f399 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25782025-01-09T01:34:57.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b9965ed-4797-498f-b5d1-4dbe4bc8f399 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25792025-01-09T01:34:57.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b9965ed-4797-498f-b5d1-4dbe4bc8f399 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25802025-01-09T01:34:58.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c1444a9-fad0-41d6-a9ff-9d70d80c0a8e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25812025-01-09T01:34:58.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c1444a9-fad0-41d6-a9ff-9d70d80c0a8e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25822025-01-09T01:34:58.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c1444a9-fad0-41d6-a9ff-9d70d80c0a8e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25832025-01-09T01:34:59.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 7246a66e-20bf-48e4-822f-7bbd6a99fbac roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
25842025-01-09T01:34:59.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 7246a66e-20bf-48e4-822f-7bbd6a99fbac resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
25852025-01-09T01:34:59.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 7246a66e-20bf-48e4-822f-7bbd6a99fbac response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
25862025-01-09T01:34:59.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 8d59e3bc-fd89-4e6a-8f06-ed9fab076f0b roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
25872025-01-09T01:34:59.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 8d59e3bc-fd89-4e6a-8f06-ed9fab076f0b resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
25882025-01-09T01:34:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 8d59e3bc-fd89-4e6a-8f06-ed9fab076f0b response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
25892025-01-09T01:34:59.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd115de7-4b3e-4c5e-8b1b-dc3db2b6434c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25902025-01-09T01:34:59.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd115de7-4b3e-4c5e-8b1b-dc3db2b6434c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25912025-01-09T01:34:59.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd115de7-4b3e-4c5e-8b1b-dc3db2b6434c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25922025-01-09T01:35:00.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eefc0322-2a70-4138-b01b-b875ab2acc4f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25932025-01-09T01:35:00.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eefc0322-2a70-4138-b01b-b875ab2acc4f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25942025-01-09T01:35:00.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eefc0322-2a70-4138-b01b-b875ab2acc4f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25952025-01-09T01:35:01.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae8da091-5d18-49f3-9f5c-b283adabc00e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25962025-01-09T01:35:01.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae8da091-5d18-49f3-9f5c-b283adabc00e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25972025-01-09T01:35:01.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae8da091-5d18-49f3-9f5c-b283adabc00e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25982025-01-09T01:35:02.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0061a9f1-1594-41d2-b8a8-7ca61790fc5f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25992025-01-09T01:35:02.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0061a9f1-1594-41d2-b8a8-7ca61790fc5f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26002025-01-09T01:35:02.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0061a9f1-1594-41d2-b8a8-7ca61790fc5f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26012025-01-09T01:35:03.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86577f31-9250-4e21-9ad8-d943abf85fe8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26022025-01-09T01:35:03.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86577f31-9250-4e21-9ad8-d943abf85fe8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26032025-01-09T01:35:03.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86577f31-9250-4e21-9ad8-d943abf85fe8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26042025-01-09T01:35:04.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 14164323-7da6-4fc3-bc80-28a89a22e39d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26052025-01-09T01:35:04.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 14164323-7da6-4fc3-bc80-28a89a22e39d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26062025-01-09T01:35:04.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 14164323-7da6-4fc3-bc80-28a89a22e39d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26072025-01-09T01:35:05.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 130dd924-66d9-4a1d-9494-707e3b890647 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26082025-01-09T01:35:05.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 130dd924-66d9-4a1d-9494-707e3b890647 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26092025-01-09T01:35:05.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 130dd924-66d9-4a1d-9494-707e3b890647 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26102025-01-09T01:35:06.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
26112025-01-09T01:35:06.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26122025-01-09T01:35:06.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26132025-01-09T01:35:06.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
26142025-01-09T01:35:06.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26152025-01-09T01:35:06.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26162025-01-09T01:35:06.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26172025-01-09T01:35:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26182025-01-09T01:35:06.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192025-01-09T01:35:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202025-01-09T01:35:06.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26212025-01-09T01:35:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26222025-01-09T01:35:06.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232025-01-09T01:35:06.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
26242025-01-09T01:35:06.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26252025-01-09T01:35:06.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26262025-01-09T01:35:06.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
26272025-01-09T01:35:06.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.360142ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
26282025-01-09T01:35:06.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26292025-01-09T01:35:06.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26302025-01-09T01:35:06.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.370565ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26312025-01-09T01:35:06.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b90b4e-e132-4bbf-a8d2-165953df6329 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26322025-01-09T01:35:06.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b90b4e-e132-4bbf-a8d2-165953df6329 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26332025-01-09T01:35:06.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b90b4e-e132-4bbf-a8d2-165953df6329 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26342025-01-09T01:35:07.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3c1928c3-75a3-4273-a6b4-5c12c9a5ba08 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26352025-01-09T01:35:07.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3c1928c3-75a3-4273-a6b4-5c12c9a5ba08 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26362025-01-09T01:35:07.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3c1928c3-75a3-4273-a6b4-5c12c9a5ba08 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26372025-01-09T01:35:08.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = efcf9cff-f641-4bc7-9940-52908a52d7b9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26382025-01-09T01:35:08.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = efcf9cff-f641-4bc7-9940-52908a52d7b9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26392025-01-09T01:35:08.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = efcf9cff-f641-4bc7-9940-52908a52d7b9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26402025-01-09T01:35:09.292ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:55235 remote_addr = [fd00:1122:3344:101::d]:51062
26412025-01-09T01:35:09.301ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8319 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 0ee17958-2728-474b-a628-dff81a6cc3ad response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
26422025-01-09T01:35:09.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29c34fc1-7b15-48e2-86a5-d05a8a04427d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26432025-01-09T01:35:09.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29c34fc1-7b15-48e2-86a5-d05a8a04427d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26442025-01-09T01:35:09.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29c34fc1-7b15-48e2-86a5-d05a8a04427d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26452025-01-09T01:35:10.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2de548a-924c-4421-8c3a-a65bf5986eb6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26462025-01-09T01:35:10.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2de548a-924c-4421-8c3a-a65bf5986eb6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26472025-01-09T01:35:10.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2de548a-924c-4421-8c3a-a65bf5986eb6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26482025-01-09T01:35:11.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c93c7a00-02bd-4747-9b6f-defbfc551a1d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26492025-01-09T01:35:11.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c93c7a00-02bd-4747-9b6f-defbfc551a1d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26502025-01-09T01:35:11.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c93c7a00-02bd-4747-9b6f-defbfc551a1d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26512025-01-09T01:35:12.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db711e5c-a7b4-4d56-866c-4e3acab8091b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26522025-01-09T01:35:12.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db711e5c-a7b4-4d56-866c-4e3acab8091b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26532025-01-09T01:35:12.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db711e5c-a7b4-4d56-866c-4e3acab8091b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26542025-01-09T01:35:13.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0afa5f50-e734-43bd-8bce-6ab8981a1915 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26552025-01-09T01:35:13.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0afa5f50-e734-43bd-8bce-6ab8981a1915 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26562025-01-09T01:35:13.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0afa5f50-e734-43bd-8bce-6ab8981a1915 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26572025-01-09T01:35:14.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 52cc069a-e7bf-4175-9c62-ac34fe910108 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
26582025-01-09T01:35:14.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 52cc069a-e7bf-4175-9c62-ac34fe910108 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
26592025-01-09T01:35:14.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 52cc069a-e7bf-4175-9c62-ac34fe910108 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
26602025-01-09T01:35:14.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 4a517404-da8e-4915-94d8-ecb7a951dd72 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
26612025-01-09T01:35:14.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 4a517404-da8e-4915-94d8-ecb7a951dd72 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
26622025-01-09T01:35:14.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 4a517404-da8e-4915-94d8-ecb7a951dd72 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
26632025-01-09T01:35:14.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c1319008-ff73-42ba-8d42-7092f0bc86a7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26642025-01-09T01:35:14.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c1319008-ff73-42ba-8d42-7092f0bc86a7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26652025-01-09T01:35:14.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c1319008-ff73-42ba-8d42-7092f0bc86a7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26662025-01-09T01:35:15.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a7e75eb-0985-423f-9c95-0b000949695a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26672025-01-09T01:35:15.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a7e75eb-0985-423f-9c95-0b000949695a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26682025-01-09T01:35:15.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a7e75eb-0985-423f-9c95-0b000949695a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26692025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
26702025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26712025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
26722025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
26732025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26742025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26752025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
26762025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26772025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26782025-01-09T01:35:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26792025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
26802025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
26812025-01-09T01:35:16.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26822025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
26832025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26842025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26852025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
26862025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26872025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
26882025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26892025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26902025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
26912025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
26922025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26932025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26942025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26952025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
26962025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
26972025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26982025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26992025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27002025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27012025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27022025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27032025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27042025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27052025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27062025-01-09T01:35:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27072025-01-09T01:35:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27082025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
27092025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27102025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
27112025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27122025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27132025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27142025-01-09T01:35:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27152025-01-09T01:35:16.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1049, tv_nsec: 7468371 } })
27162025-01-09T01:35:16.603ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27172025-01-09T01:35:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
27182025-01-09T01:35:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27192025-01-09T01:35:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
27202025-01-09T01:35:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27212025-01-09T01:35:16.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1049, tv_nsec: 8053820 } })
27222025-01-09T01:35:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27232025-01-09T01:35:16.604ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27242025-01-09T01:35:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27252025-01-09T01:35:16.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27262025-01-09T01:35:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27272025-01-09T01:35:16.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27282025-01-09T01:35:16.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.024677ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27292025-01-09T01:35:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27302025-01-09T01:35:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27312025-01-09T01:35:16.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27322025-01-09T01:35:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27332025-01-09T01:35:16.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27342025-01-09T01:35:16.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27352025-01-09T01:35:16.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362025-01-09T01:35:16.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372025-01-09T01:35:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27382025-01-09T01:35:16.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27392025-01-09T01:35:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27402025-01-09T01:35:16.611ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27412025-01-09T01:35:16.611ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27422025-01-09T01:35:16.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27432025-01-09T01:35:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27442025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27452025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27462025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27472025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27482025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27492025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27502025-01-09T01:35:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27512025-01-09T01:35:16.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27522025-01-09T01:35:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27532025-01-09T01:35:16.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.087543ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
27542025-01-09T01:35:16.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27552025-01-09T01:35:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27562025-01-09T01:35:16.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27572025-01-09T01:35:16.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27582025-01-09T01:35:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27592025-01-09T01:35:16.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27602025-01-09T01:35:16.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27612025-01-09T01:35:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27622025-01-09T01:35:16.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1049, tv_nsec: 26704900 } })
27632025-01-09T01:35:16.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
27642025-01-09T01:35:16.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27652025-01-09T01:35:16.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27662025-01-09T01:35:16.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.102843ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27672025-01-09T01:35:16.650ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27682025-01-09T01:35:16.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27692025-01-09T01:35:16.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27702025-01-09T01:35:16.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27712025-01-09T01:35:16.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27722025-01-09T01:35:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27732025-01-09T01:35:16.657ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27742025-01-09T01:35:16.657ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.109393ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27752025-01-09T01:35:16.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.67327ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
27762025-01-09T01:35:16.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-01-09T01:35:16.665ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27782025-01-09T01:35:16.665ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27792025-01-09T01:35:16.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27802025-01-09T01:35:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27812025-01-09T01:35:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
27822025-01-09T01:35:16.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27832025-01-09T01:35:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27842025-01-09T01:35:16.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27852025-01-09T01:35:16.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27862025-01-09T01:35:16.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27872025-01-09T01:35:16.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27882025-01-09T01:35:16.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27892025-01-09T01:35:16.679ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27902025-01-09T01:35:16.680ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74fbc226-16a8-4a00-a55d-fbab73b68aa0", "content-length": "26", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
27912025-01-09T01:35:16.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27922025-01-09T01:35:16.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27932025-01-09T01:35:16.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27942025-01-09T01:35:16.692ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27952025-01-09T01:35:16.692ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a2140c6-c5b9-41ca-9b2b-0a437638d2e3", "content-length": "26", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
27962025-01-09T01:35:16.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27972025-01-09T01:35:16.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27982025-01-09T01:35:16.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27992025-01-09T01:35:16.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28002025-01-09T01:35:16.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28012025-01-09T01:35:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28022025-01-09T01:35:16.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
28032025-01-09T01:35:16.735ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28042025-01-09T01:35:16.735ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6a74818-1d5c-488c-80ba-6815032bcc97", "content-length": "26", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28052025-01-09T01:35:16.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28062025-01-09T01:35:16.737ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
28072025-01-09T01:35:16.750ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28082025-01-09T01:35:16.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28092025-01-09T01:35:16.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "73b0bf95-3aca-4c52-a8da-d908a99b11c9", "content-length": "372", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28102025-01-09T01:35:16.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28112025-01-09T01:35:16.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28122025-01-09T01:35:16.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28132025-01-09T01:35:16.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28142025-01-09T01:35:16.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28152025-01-09T01:35:16.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28162025-01-09T01:35:16.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 198.143787ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28172025-01-09T01:35:16.800ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28182025-01-09T01:35:16.800ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28192025-01-09T01:35:16.800ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 199.231475ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28202025-01-09T01:35:16.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28212025-01-09T01:35:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28222025-01-09T01:35:16.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 200.012737ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28232025-01-09T01:35:16.816ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28242025-01-09T01:35:16.817ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "607d6bab-4906-4cb5-a1f5-26efae6d1b64", "content-length": "1", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28252025-01-09T01:35:16.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28262025-01-09T01:35:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28272025-01-09T01:35:16.823ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 223.195071ms iteration = 4 status = null
28282025-01-09T01:35:16.830ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28292025-01-09T01:35:16.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28302025-01-09T01:35:16.830ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "41a44e14-df3e-415b-851f-b51379224476", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28312025-01-09T01:35:16.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28322025-01-09T01:35:16.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28332025-01-09T01:35:16.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28342025-01-09T01:35:16.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28352025-01-09T01:35:16.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28362025-01-09T01:35:16.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
28372025-01-09T01:35:16.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28382025-01-09T01:35:16.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28392025-01-09T01:35:16.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28402025-01-09T01:35:16.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28412025-01-09T01:35:16.844ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28422025-01-09T01:35:16.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28432025-01-09T01:35:16.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dcb16be1-f988-4eb8-b25e-246ec690e896", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28442025-01-09T01:35:16.847ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 245.56254ms iteration = 4 status = {}
28452025-01-09T01:35:16.848ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 246.957312ms iteration = 4 status = 0
28462025-01-09T01:35:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 247.279028ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28472025-01-09T01:35:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 265.596363ms iteration = 4 status = {}
28482025-01-09T01:35:16.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
28492025-01-09T01:35:16.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 269.81055ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
28502025-01-09T01:35:16.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28512025-01-09T01:35:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28522025-01-09T01:35:16.896ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 294.69168ms iteration = 6 status = {"physical_disks_added":0}
28532025-01-09T01:35:16.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542025-01-09T01:35:16.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28552025-01-09T01:35:16.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28562025-01-09T01:35:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28572025-01-09T01:35:16.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582025-01-09T01:35:16.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28592025-01-09T01:35:16.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28602025-01-09T01:35:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28612025-01-09T01:35:16.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28622025-01-09T01:35:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28632025-01-09T01:35:16.941ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
28642025-01-09T01:35:16.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28652025-01-09T01:35:16.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28662025-01-09T01:35:16.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79b4b796-1b52-4a1e-b44d-d9498b7a0b71 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
28672025-01-09T01:35:16.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79b4b796-1b52-4a1e-b44d-d9498b7a0b71 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
28682025-01-09T01:35:16.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79b4b796-1b52-4a1e-b44d-d9498b7a0b71 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
28692025-01-09T01:35:17.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28702025-01-09T01:35:17.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a05ed80-d8fc-4ef9-b690-276d42dd8d5d", "content-length": "134", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28712025-01-09T01:35:17.015ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28722025-01-09T01:35:17.015ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
28732025-01-09T01:35:17.015ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28742025-01-09T01:35:17.015ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28752025-01-09T01:35:17.015ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28762025-01-09T01:35:17.015ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28772025-01-09T01:35:17.016ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28782025-01-09T01:35:17.016ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28792025-01-09T01:35:17.016ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28802025-01-09T01:35:17.016ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28812025-01-09T01:35:17.016ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
28822025-01-09T01:35:17.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28832025-01-09T01:35:17.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28842025-01-09T01:35:17.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28852025-01-09T01:35:17.041ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28862025-01-09T01:35:17.041ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5f72ed-f92f-4ddf-a028-c6cc971b33cf", "content-length": "2", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28872025-01-09T01:35:17.041ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28882025-01-09T01:35:17.041ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "637d9ea6-2529-4194-996a-082847626f97", "content-length": "52", "date": "Thu, 09 Jan 2025 01:35:16 GMT"} })
28892025-01-09T01:35:17.041ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
28902025-01-09T01:35:17.042ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28912025-01-09T01:35:17.131ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0696dbf-fde7-4b1f-81f7-dea75185183a", "content-length": "691", "date": "Thu, 09 Jan 2025 01:35:17 GMT"} })
28922025-01-09T01:35:17.131ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28932025-01-09T01:35:17.131ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28942025-01-09T01:35:17.131ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28952025-01-09T01:35:17.132ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 531.222195ms iteration = 4 status = {}
28962025-01-09T01:35:17.232ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d363250f-11e5-4889-81d7-cc687f53bba2", "date": "Thu, 09 Jan 2025 01:35:17 GMT"} })
28972025-01-09T01:35:17.232ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
28982025-01-09T01:35:17.232ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28992025-01-09T01:35:17.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a8ab8ed-8794-4291-8576-62283ba83e20", "content-length": "682", "date": "Thu, 09 Jan 2025 01:35:17 GMT"} })
29002025-01-09T01:35:17.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29012025-01-09T01:35:17.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29022025-01-09T01:35:17.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29032025-01-09T01:35:17.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29042025-01-09T01:35:17.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29052025-01-09T01:35:17.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29062025-01-09T01:35:17.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29072025-01-09T01:35:17.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29082025-01-09T01:35:17.368ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 767.212741ms iteration = 4 status = {}
29092025-01-09T01:35:17.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 98be266f-9d6b-440f-a8c4-b04aa1f368fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
29102025-01-09T01:35:17.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 98be266f-9d6b-440f-a8c4-b04aa1f368fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
29112025-01-09T01:35:17.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 98be266f-9d6b-440f-a8c4-b04aa1f368fd response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
29122025-01-09T01:35:17.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f94d340-8540-4f6d-891c-89eaf984a966 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29132025-01-09T01:35:17.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f94d340-8540-4f6d-891c-89eaf984a966 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29142025-01-09T01:35:17.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f94d340-8540-4f6d-891c-89eaf984a966 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29152025-01-09T01:35:18.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5b588c2c-94be-415c-b1e6-e2c4d7a6631b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29162025-01-09T01:35:18.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5b588c2c-94be-415c-b1e6-e2c4d7a6631b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29172025-01-09T01:35:18.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5b588c2c-94be-415c-b1e6-e2c4d7a6631b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29182025-01-09T01:35:19.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = d5d81aeb-8ab1-4855-ad33-d375f9272798 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
29192025-01-09T01:35:20.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be9d201b-4c88-47d1-9d2f-bdd7881d2176 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29202025-01-09T01:35:20.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be9d201b-4c88-47d1-9d2f-bdd7881d2176 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29212025-01-09T01:35:20.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be9d201b-4c88-47d1-9d2f-bdd7881d2176 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29222025-01-09T01:35:21.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7f1d4dfe-19fe-4166-a360-7b595ab570ef roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29232025-01-09T01:35:21.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7f1d4dfe-19fe-4166-a360-7b595ab570ef resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29242025-01-09T01:35:21.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7f1d4dfe-19fe-4166-a360-7b595ab570ef response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29252025-01-09T01:35:22.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33175398-4bee-4f77-b1a1-1b4f7f9396c6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29262025-01-09T01:35:22.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33175398-4bee-4f77-b1a1-1b4f7f9396c6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29272025-01-09T01:35:22.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33175398-4bee-4f77-b1a1-1b4f7f9396c6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29282025-01-09T01:35:23.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b714df60-fda3-4bf8-8dc3-2bbb5061c4c3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29292025-01-09T01:35:23.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b714df60-fda3-4bf8-8dc3-2bbb5061c4c3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29302025-01-09T01:35:23.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b714df60-fda3-4bf8-8dc3-2bbb5061c4c3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29312025-01-09T01:35:24.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36507384-955e-4837-ac15-dca13f8c5057 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29322025-01-09T01:35:24.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36507384-955e-4837-ac15-dca13f8c5057 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29332025-01-09T01:35:24.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36507384-955e-4837-ac15-dca13f8c5057 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29342025-01-09T01:35:25.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 228f9e5b-5176-463b-8c88-6ffe5126203a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29352025-01-09T01:35:25.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 228f9e5b-5176-463b-8c88-6ffe5126203a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29362025-01-09T01:35:25.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 228f9e5b-5176-463b-8c88-6ffe5126203a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29372025-01-09T01:35:26.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53799991-62c3-4afe-b8de-0aa9bba4c61e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29382025-01-09T01:35:26.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53799991-62c3-4afe-b8de-0aa9bba4c61e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29392025-01-09T01:35:26.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53799991-62c3-4afe-b8de-0aa9bba4c61e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29402025-01-09T01:35:26.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
29412025-01-09T01:35:26.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29422025-01-09T01:35:26.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29432025-01-09T01:35:26.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
29442025-01-09T01:35:26.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29452025-01-09T01:35:26.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29462025-01-09T01:35:26.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472025-01-09T01:35:26.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29482025-01-09T01:35:26.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29492025-01-09T01:35:26.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.178911ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29502025-01-09T01:35:26.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29512025-01-09T01:35:26.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29522025-01-09T01:35:26.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29532025-01-09T01:35:26.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29542025-01-09T01:35:26.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29552025-01-09T01:35:26.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562025-01-09T01:35:26.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
29572025-01-09T01:35:26.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29582025-01-09T01:35:26.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29592025-01-09T01:35:26.648ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
29602025-01-09T01:35:26.648ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.378682ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
29612025-01-09T01:35:27.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09f27c9f-2006-4adf-adea-b4f147a1f475 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29622025-01-09T01:35:27.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09f27c9f-2006-4adf-adea-b4f147a1f475 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29632025-01-09T01:35:27.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09f27c9f-2006-4adf-adea-b4f147a1f475 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29642025-01-09T01:35:28.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3499bd1e-d104-4420-9e4e-b103f3dfd403 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29652025-01-09T01:35:28.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3499bd1e-d104-4420-9e4e-b103f3dfd403 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29662025-01-09T01:35:28.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3499bd1e-d104-4420-9e4e-b103f3dfd403 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29672025-01-09T01:35:29.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 20389229-0ebd-4c6e-9fd3-84ed91d8e569 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29682025-01-09T01:35:29.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 20389229-0ebd-4c6e-9fd3-84ed91d8e569 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29692025-01-09T01:35:29.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 20389229-0ebd-4c6e-9fd3-84ed91d8e569 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29702025-01-09T01:35:29.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = fa93e11f-5279-41b5-ad79-ce86ad0dec62 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
29712025-01-09T01:35:30.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 883bfd72-89ea-4b7c-9a8e-1342bec0fda4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29722025-01-09T01:35:30.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 883bfd72-89ea-4b7c-9a8e-1342bec0fda4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29732025-01-09T01:35:30.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 883bfd72-89ea-4b7c-9a8e-1342bec0fda4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29742025-01-09T01:35:31.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e69f5a7-1d66-4417-b474-d02e6fdb7b33 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29752025-01-09T01:35:31.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e69f5a7-1d66-4417-b474-d02e6fdb7b33 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29762025-01-09T01:35:31.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e69f5a7-1d66-4417-b474-d02e6fdb7b33 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29772025-01-09T01:35:32.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a68cab5a-f173-49a9-b962-2c5c80326366 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29782025-01-09T01:35:32.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a68cab5a-f173-49a9-b962-2c5c80326366 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29792025-01-09T01:35:32.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a68cab5a-f173-49a9-b962-2c5c80326366 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29802025-01-09T01:35:33.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 478c805b-797b-49d9-857a-49aac7dac8f3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29812025-01-09T01:35:33.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 478c805b-797b-49d9-857a-49aac7dac8f3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29822025-01-09T01:35:33.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 478c805b-797b-49d9-857a-49aac7dac8f3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29832025-01-09T01:35:34.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e643ce72-5159-4518-a5aa-72fc6b6d03bc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29842025-01-09T01:35:34.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e643ce72-5159-4518-a5aa-72fc6b6d03bc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29852025-01-09T01:35:34.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e643ce72-5159-4518-a5aa-72fc6b6d03bc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29862025-01-09T01:35:35.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e53264d1-0bf1-4cc5-b035-0f365238ec65 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29872025-01-09T01:35:35.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e53264d1-0bf1-4cc5-b035-0f365238ec65 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29882025-01-09T01:35:35.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e53264d1-0bf1-4cc5-b035-0f365238ec65 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29892025-01-09T01:35:36.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b0d9103-3a09-4486-8b39-3abeafbb494c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29902025-01-09T01:35:36.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b0d9103-3a09-4486-8b39-3abeafbb494c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29912025-01-09T01:35:36.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b0d9103-3a09-4486-8b39-3abeafbb494c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29922025-01-09T01:35:36.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
29932025-01-09T01:35:36.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29942025-01-09T01:35:36.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29952025-01-09T01:35:36.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
29962025-01-09T01:35:36.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29972025-01-09T01:35:36.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29982025-01-09T01:35:36.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29992025-01-09T01:35:36.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30002025-01-09T01:35:36.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30012025-01-09T01:35:36.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30022025-01-09T01:35:36.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30032025-01-09T01:35:36.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30042025-01-09T01:35:36.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.3079ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30052025-01-09T01:35:36.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30062025-01-09T01:35:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30072025-01-09T01:35:36.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30082025-01-09T01:35:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
30092025-01-09T01:35:36.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30102025-01-09T01:35:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30112025-01-09T01:35:36.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
30122025-01-09T01:35:36.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.070263ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
30132025-01-09T01:35:37.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82317fa9-dcda-4cf3-bcf8-455d8cb0e9a9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30142025-01-09T01:35:37.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82317fa9-dcda-4cf3-bcf8-455d8cb0e9a9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30152025-01-09T01:35:37.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82317fa9-dcda-4cf3-bcf8-455d8cb0e9a9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30162025-01-09T01:35:38.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 10f62f23-5291-4fd2-bd29-862abb715371 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30172025-01-09T01:35:38.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 10f62f23-5291-4fd2-bd29-862abb715371 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30182025-01-09T01:35:38.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 10f62f23-5291-4fd2-bd29-862abb715371 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30192025-01-09T01:35:39.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = b359ad82-c5f0-4a05-8ee6-f897aa76702c response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
30202025-01-09T01:35:39.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 80130ddb-d39b-48a0-9b06-ba94d8e231ea roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30212025-01-09T01:35:39.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 80130ddb-d39b-48a0-9b06-ba94d8e231ea resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30222025-01-09T01:35:39.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 80130ddb-d39b-48a0-9b06-ba94d8e231ea response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30232025-01-09T01:35:40.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0074ba23-6569-45b2-8af2-0bd833b50fae roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30242025-01-09T01:35:40.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0074ba23-6569-45b2-8af2-0bd833b50fae resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30252025-01-09T01:35:40.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0074ba23-6569-45b2-8af2-0bd833b50fae response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30262025-01-09T01:35:41.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a7503f6d-73b7-4487-80c2-2554be00bff2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30272025-01-09T01:35:41.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a7503f6d-73b7-4487-80c2-2554be00bff2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30282025-01-09T01:35:41.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a7503f6d-73b7-4487-80c2-2554be00bff2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30292025-01-09T01:35:42.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58afb177-d63a-45e5-9f8f-508a536a57d3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30302025-01-09T01:35:42.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58afb177-d63a-45e5-9f8f-508a536a57d3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30312025-01-09T01:35:42.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58afb177-d63a-45e5-9f8f-508a536a57d3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30322025-01-09T01:35:43.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 762cdcd7-4382-4bd6-a25a-33b262f6df87 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30332025-01-09T01:35:43.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 762cdcd7-4382-4bd6-a25a-33b262f6df87 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30342025-01-09T01:35:43.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 762cdcd7-4382-4bd6-a25a-33b262f6df87 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30352025-01-09T01:35:44.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 0b0ef8d9-c38e-46f5-849c-5395b684e72e roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
30362025-01-09T01:35:44.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 0b0ef8d9-c38e-46f5-849c-5395b684e72e resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
30372025-01-09T01:35:44.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 0b0ef8d9-c38e-46f5-849c-5395b684e72e response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
30382025-01-09T01:35:44.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1281220f-4919-480b-b5ce-eb51bb23313b roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
30392025-01-09T01:35:44.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1281220f-4919-480b-b5ce-eb51bb23313b resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
30402025-01-09T01:35:44.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1281220f-4919-480b-b5ce-eb51bb23313b response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
30412025-01-09T01:35:44.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44eca2f0-829b-4a29-8b97-f62544149b13 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30422025-01-09T01:35:44.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44eca2f0-829b-4a29-8b97-f62544149b13 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30432025-01-09T01:35:44.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44eca2f0-829b-4a29-8b97-f62544149b13 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30442025-01-09T01:35:45.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 07fd5c49-b2fe-4057-8058-505f5d11b69c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30452025-01-09T01:35:45.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 07fd5c49-b2fe-4057-8058-505f5d11b69c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30462025-01-09T01:35:45.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 07fd5c49-b2fe-4057-8058-505f5d11b69c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30472025-01-09T01:35:46.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 28fdacc8-df06-4297-8121-2d3441788341 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30482025-01-09T01:35:46.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 28fdacc8-df06-4297-8121-2d3441788341 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30492025-01-09T01:35:46.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 28fdacc8-df06-4297-8121-2d3441788341 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30502025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
30512025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
30522025-01-09T01:35:46.600ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
30532025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
30542025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.93\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
30552025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
30562025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30572025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
30582025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30592025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30602025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
30612025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
30622025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
30632025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
30642025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30652025-01-09T01:35:46.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30662025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
30672025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
30682025-01-09T01:35:46.601ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:25:46.600924933 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30692025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30702025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
30712025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30722025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
30732025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30742025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30752025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30762025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30772025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30782025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30792025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30802025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30812025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
30822025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30832025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
30842025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30852025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
30862025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
30872025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30882025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30892025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30902025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
30912025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30922025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
30932025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30942025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
30952025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30962025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30972025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
30982025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
30992025-01-09T01:35:46.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31002025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31012025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31022025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
31032025-01-09T01:35:46.601ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31042025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31052025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
31062025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31072025-01-09T01:35:46.601ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 5346647 } })
31082025-01-09T01:35:46.601ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 5386197 } })
31092025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31102025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31112025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31122025-01-09T01:35:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31132025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31142025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31152025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31162025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31172025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31182025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31192025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31202025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31212025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.406882ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
31222025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
31232025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.613766ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
31242025-01-09T01:35:46.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31252025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31262025-01-09T01:35:46.603ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:25:46.600924933 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31272025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
31282025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.764734ms iteration = 3 status = {"expiration":"2025-01-09T01:25:46.600924933Z","pruned":[]}
31292025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
31302025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31312025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31322025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
31332025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31342025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
31352025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31362025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31372025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31382025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31392025-01-09T01:35:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31402025-01-09T01:35:46.604ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.548957ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31412025-01-09T01:35:46.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422025-01-09T01:35:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31432025-01-09T01:35:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
31442025-01-09T01:35:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31452025-01-09T01:35:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31462025-01-09T01:35:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31472025-01-09T01:35:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31482025-01-09T01:35:46.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 8711321 } })
31492025-01-09T01:35:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31502025-01-09T01:35:46.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
31512025-01-09T01:35:46.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522025-01-09T01:35:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31532025-01-09T01:35:46.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31542025-01-09T01:35:46.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31552025-01-09T01:35:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31562025-01-09T01:35:46.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 10310026 } })
31572025-01-09T01:35:46.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31582025-01-09T01:35:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31592025-01-09T01:35:46.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31602025-01-09T01:35:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31612025-01-09T01:35:46.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31622025-01-09T01:35:46.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31632025-01-09T01:35:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31642025-01-09T01:35:46.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31652025-01-09T01:35:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31662025-01-09T01:35:46.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672025-01-09T01:35:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31682025-01-09T01:35:46.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31692025-01-09T01:35:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31702025-01-09T01:35:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31712025-01-09T01:35:46.615ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31722025-01-09T01:35:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31732025-01-09T01:35:46.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31742025-01-09T01:35:46.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31752025-01-09T01:35:46.624ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.984898ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
31762025-01-09T01:35:46.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 33158304 } })
31772025-01-09T01:35:46.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
31782025-01-09T01:35:46.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.887703ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
31792025-01-09T01:35:46.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31802025-01-09T01:35:46.632ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31812025-01-09T01:35:46.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31822025-01-09T01:35:46.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31832025-01-09T01:35:46.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31842025-01-09T01:35:46.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31852025-01-09T01:35:46.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31862025-01-09T01:35:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31872025-01-09T01:35:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31882025-01-09T01:35:46.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31892025-01-09T01:35:46.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31902025-01-09T01:35:46.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31912025-01-09T01:35:46.641ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31922025-01-09T01:35:46.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31932025-01-09T01:35:46.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31942025-01-09T01:35:46.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31952025-01-09T01:35:46.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31962025-01-09T01:35:46.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.316695ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31972025-01-09T01:35:46.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31982025-01-09T01:35:46.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31992025-01-09T01:35:46.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32002025-01-09T01:35:46.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32012025-01-09T01:35:46.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022025-01-09T01:35:46.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32032025-01-09T01:35:46.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32042025-01-09T01:35:46.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32052025-01-09T01:35:46.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32062025-01-09T01:35:46.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32072025-01-09T01:35:46.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32082025-01-09T01:35:46.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32092025-01-09T01:35:46.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32102025-01-09T01:35:46.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32112025-01-09T01:35:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32122025-01-09T01:35:46.664ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32132025-01-09T01:35:46.664ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32142025-01-09T01:35:46.664ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32152025-01-09T01:35:46.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32162025-01-09T01:35:46.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172025-01-09T01:35:46.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32182025-01-09T01:35:46.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32192025-01-09T01:35:46.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32202025-01-09T01:35:46.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32212025-01-09T01:35:46.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32222025-01-09T01:35:46.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32232025-01-09T01:35:46.668ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32242025-01-09T01:35:46.668ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32252025-01-09T01:35:46.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32262025-01-09T01:35:46.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32272025-01-09T01:35:46.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32282025-01-09T01:35:46.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32292025-01-09T01:35:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32302025-01-09T01:35:46.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.084375ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
32312025-01-09T01:35:46.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32322025-01-09T01:35:46.672ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32332025-01-09T01:35:46.672ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32342025-01-09T01:35:46.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32352025-01-09T01:35:46.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32362025-01-09T01:35:46.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32372025-01-09T01:35:46.674ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32382025-01-09T01:35:46.674ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32392025-01-09T01:35:46.674ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.523095ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32402025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32412025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32422025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32432025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32442025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32452025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32462025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32472025-01-09T01:35:46.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32482025-01-09T01:35:46.678ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32492025-01-09T01:35:46.679ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32502025-01-09T01:35:46.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32512025-01-09T01:35:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32522025-01-09T01:35:46.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.318476ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32532025-01-09T01:35:46.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32542025-01-09T01:35:46.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32552025-01-09T01:35:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32562025-01-09T01:35:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
32572025-01-09T01:35:46.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32582025-01-09T01:35:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32592025-01-09T01:35:46.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32602025-01-09T01:35:46.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32612025-01-09T01:35:46.721ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
32622025-01-09T01:35:46.721ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 121.018047ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32632025-01-09T01:35:46.735ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32642025-01-09T01:35:46.736ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32652025-01-09T01:35:46.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 134.767937ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32662025-01-09T01:35:46.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32672025-01-09T01:35:46.741ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32682025-01-09T01:35:46.743ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5d859b2-d5d9-4aec-811d-c9284e8bccf8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
32692025-01-09T01:35:46.743ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32702025-01-09T01:35:46.744ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32712025-01-09T01:35:46.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32722025-01-09T01:35:46.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732025-01-09T01:35:46.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32742025-01-09T01:35:46.751ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32752025-01-09T01:35:46.751ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32762025-01-09T01:35:46.751ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.513514ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32772025-01-09T01:35:46.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32782025-01-09T01:35:46.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32792025-01-09T01:35:46.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32802025-01-09T01:35:46.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32812025-01-09T01:35:46.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32822025-01-09T01:35:46.754ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32832025-01-09T01:35:46.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32842025-01-09T01:35:46.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32852025-01-09T01:35:46.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32862025-01-09T01:35:46.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32872025-01-09T01:35:46.759ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
32882025-01-09T01:35:46.759ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32892025-01-09T01:35:46.759ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
32902025-01-09T01:35:46.760ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.15714ms iteration = 3 status = {"generation":1}
32912025-01-09T01:35:46.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32922025-01-09T01:35:46.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32932025-01-09T01:35:46.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32942025-01-09T01:35:46.764ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32952025-01-09T01:35:46.764ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a49038d-3844-4248-a561-4c6c581a39ff", "content-length": "26", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
32962025-01-09T01:35:46.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32972025-01-09T01:35:46.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32982025-01-09T01:35:46.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32992025-01-09T01:35:46.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33002025-01-09T01:35:46.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33012025-01-09T01:35:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33022025-01-09T01:35:46.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33032025-01-09T01:35:46.775ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33042025-01-09T01:35:46.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33052025-01-09T01:35:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
33062025-01-09T01:35:46.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33072025-01-09T01:35:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33082025-01-09T01:35:46.782ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 180.670777ms iteration = 5 status = 0
33092025-01-09T01:35:46.790ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33102025-01-09T01:35:46.790ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33112025-01-09T01:35:46.790ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 189.014321ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33122025-01-09T01:35:46.809ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
33132025-01-09T01:35:46.809ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 208.90137ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
33142025-01-09T01:35:46.813ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33152025-01-09T01:35:46.813ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
33162025-01-09T01:35:46.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33172025-01-09T01:35:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33182025-01-09T01:35:46.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 212.794783ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33192025-01-09T01:35:46.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202025-01-09T01:35:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33212025-01-09T01:35:46.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33222025-01-09T01:35:46.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33232025-01-09T01:35:46.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 217.812884ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33242025-01-09T01:35:46.822ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
33252025-01-09T01:35:46.822ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33262025-01-09T01:35:46.822ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
33272025-01-09T01:35:46.822ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 221.031856ms iteration = 3 status = {"generation":2}
33282025-01-09T01:35:46.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33292025-01-09T01:35:46.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33302025-01-09T01:35:46.858ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
33312025-01-09T01:35:46.858ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33322025-01-09T01:35:46.859ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0849d702-8ad7-4b50-951d-1ac4e98d8b3b", "content-length": "26", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
33332025-01-09T01:35:46.859ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33342025-01-09T01:35:46.859ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33352025-01-09T01:35:46.859ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 258.026681ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33362025-01-09T01:35:46.861ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
33372025-01-09T01:35:46.877ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 276.107321ms iteration = 7 status = {"physical_disks_added":0}
33382025-01-09T01:35:46.881ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33392025-01-09T01:35:46.881ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8b0c2bbc-3119-4588-a392-d0722617a1df", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33402025-01-09T01:35:46.881ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33412025-01-09T01:35:46.883ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ede4a841-b68a-4a29-bd6c-44692b3fae33", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33422025-01-09T01:35:46.883ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33432025-01-09T01:35:46.885ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33442025-01-09T01:35:46.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 284.923623ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33452025-01-09T01:35:46.903ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33462025-01-09T01:35:46.903ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4ca63f-012d-4e41-aeae-13a82b12c41a", "content-length": "1", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
33472025-01-09T01:35:46.906ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33482025-01-09T01:35:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33492025-01-09T01:35:46.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33502025-01-09T01:35:46.926ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33512025-01-09T01:35:46.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33522025-01-09T01:35:46.927ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.040115ms iteration = 5 status = {}
33532025-01-09T01:35:46.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e68bde1-3a61-4cec-a03b-dcfa8e7a2825", "content-length": "372", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
33542025-01-09T01:35:46.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33552025-01-09T01:35:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33562025-01-09T01:35:46.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33572025-01-09T01:35:46.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33582025-01-09T01:35:46.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33592025-01-09T01:35:46.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33602025-01-09T01:35:46.937ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.025305ms iteration = 5 status = null
33612025-01-09T01:35:46.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33622025-01-09T01:35:46.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f23d94f2-73e4-4e1c-a97a-82b0c4145675", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33632025-01-09T01:35:46.966ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33642025-01-09T01:35:46.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "46d2abfb-dcc7-4950-82a3-354adf4a3b5d", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33652025-01-09T01:35:46.968ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33662025-01-09T01:35:46.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ce851c82-c3a9-4202-82ea-1983ce352004", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33672025-01-09T01:35:46.970ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33682025-01-09T01:35:46.971ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33692025-01-09T01:35:46.971ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 370.52074ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33702025-01-09T01:35:46.981ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33712025-01-09T01:35:46.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33722025-01-09T01:35:46.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e7bd17ff-5881-4b86-af4c-7247a2be23e6", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
33732025-01-09T01:35:46.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33742025-01-09T01:35:46.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752025-01-09T01:35:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33762025-01-09T01:35:46.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33772025-01-09T01:35:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33782025-01-09T01:35:46.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33792025-01-09T01:35:46.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33802025-01-09T01:35:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33812025-01-09T01:35:46.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33822025-01-09T01:35:46.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33832025-01-09T01:35:46.991ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33842025-01-09T01:35:46.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33852025-01-09T01:35:46.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "92906542-3586-472f-993a-71b012ebf05b", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
33862025-01-09T01:35:46.995ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.046948ms iteration = 5 status = {}
33872025-01-09T01:35:47.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33882025-01-09T01:35:47.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33892025-01-09T01:35:47.023ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
33902025-01-09T01:35:47.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33912025-01-09T01:35:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33922025-01-09T01:35:47.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33932025-01-09T01:35:47.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7279d9a1-4518-4345-84aa-5e5368687b7b", "content-length": "691", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
33942025-01-09T01:35:47.078ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33952025-01-09T01:35:47.078ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33962025-01-09T01:35:47.078ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33972025-01-09T01:35:47.079ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 477.892247ms iteration = 5 status = {}
33982025-01-09T01:35:47.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33992025-01-09T01:35:47.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa319e11-c1f8-4314-a69b-47c1123d3d3f", "content-length": "134", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
34002025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34012025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
34022025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34032025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34042025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34052025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34062025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34072025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34082025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34092025-01-09T01:35:47.142ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34102025-01-09T01:35:47.143ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
34112025-01-09T01:35:47.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34122025-01-09T01:35:47.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34132025-01-09T01:35:47.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34142025-01-09T01:35:47.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "47eb9dc8-56cd-4269-8fe7-c19fe021bff8", "content-length": "2", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
34152025-01-09T01:35:47.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34162025-01-09T01:35:47.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "29f5d11e-7eda-4aee-8498-2f5323471563", "content-length": "52", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
34172025-01-09T01:35:47.145ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
34182025-01-09T01:35:47.145ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34192025-01-09T01:35:47.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "03ad25b2-139d-4799-8973-a89fd7a68594", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
34202025-01-09T01:35:47.244ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
34212025-01-09T01:35:47.244ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34222025-01-09T01:35:47.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "44245629-a426-418f-9ede-cab6719c47ca", "content-length": "682", "date": "Thu, 09 Jan 2025 01:35:46 GMT"} })
34232025-01-09T01:35:47.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34242025-01-09T01:35:47.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34252025-01-09T01:35:47.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34262025-01-09T01:35:47.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34272025-01-09T01:35:47.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34282025-01-09T01:35:47.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34292025-01-09T01:35:47.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34302025-01-09T01:35:47.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34312025-01-09T01:35:47.267ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 665.657107ms iteration = 5 status = {}
34322025-01-09T01:35:47.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6fa253c5-c34f-4cf0-8b69-c697956be0a2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34332025-01-09T01:35:47.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6fa253c5-c34f-4cf0-8b69-c697956be0a2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34342025-01-09T01:35:47.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6fa253c5-c34f-4cf0-8b69-c697956be0a2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34352025-01-09T01:35:47.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3122f06c-d240-458f-9b1e-ecdbe51558c7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
34362025-01-09T01:35:47.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3122f06c-d240-458f-9b1e-ecdbe51558c7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
34372025-01-09T01:35:47.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3122f06c-d240-458f-9b1e-ecdbe51558c7 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
34382025-01-09T01:35:48.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d05ad413-9726-42d9-ae04-92d485160c3d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34392025-01-09T01:35:48.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d05ad413-9726-42d9-ae04-92d485160c3d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34402025-01-09T01:35:48.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d05ad413-9726-42d9-ae04-92d485160c3d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34412025-01-09T01:35:49.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 652 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = fb1eb3da-4ecb-43f7-ada6-42ced2047672 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
34422025-01-09T01:35:49.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2266ffac-69b3-4564-9c96-dd101763bb4b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34432025-01-09T01:35:49.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2266ffac-69b3-4564-9c96-dd101763bb4b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34442025-01-09T01:35:49.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2266ffac-69b3-4564-9c96-dd101763bb4b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34452025-01-09T01:35:50.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0a9f7e20-4dc5-4ff9-9541-7a1ae53a27ec roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34462025-01-09T01:35:50.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0a9f7e20-4dc5-4ff9-9541-7a1ae53a27ec resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34472025-01-09T01:35:50.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0a9f7e20-4dc5-4ff9-9541-7a1ae53a27ec response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34482025-01-09T01:35:51.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38f1d0e9-2559-403c-81ea-0861fe2d54d8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34492025-01-09T01:35:51.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38f1d0e9-2559-403c-81ea-0861fe2d54d8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34502025-01-09T01:35:51.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38f1d0e9-2559-403c-81ea-0861fe2d54d8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34512025-01-09T01:35:52.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae5d6b47-d36c-48a8-b1c8-cd117f7e369e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34522025-01-09T01:35:52.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae5d6b47-d36c-48a8-b1c8-cd117f7e369e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34532025-01-09T01:35:52.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae5d6b47-d36c-48a8-b1c8-cd117f7e369e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34542025-01-09T01:35:53.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33262da7-77cd-4c44-b1c6-151bb568d91a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34552025-01-09T01:35:53.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33262da7-77cd-4c44-b1c6-151bb568d91a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34562025-01-09T01:35:53.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33262da7-77cd-4c44-b1c6-151bb568d91a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34572025-01-09T01:35:54.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2c24f75-d0e1-4255-a488-3de2e6a12da3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34582025-01-09T01:35:54.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2c24f75-d0e1-4255-a488-3de2e6a12da3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34592025-01-09T01:35:54.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2c24f75-d0e1-4255-a488-3de2e6a12da3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34602025-01-09T01:35:55.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a6710c56-fa4e-4c43-9fec-fbfe85e23ad5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34612025-01-09T01:35:55.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a6710c56-fa4e-4c43-9fec-fbfe85e23ad5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34622025-01-09T01:35:55.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a6710c56-fa4e-4c43-9fec-fbfe85e23ad5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34632025-01-09T01:35:56.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
34642025-01-09T01:35:56.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34652025-01-09T01:35:56.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34662025-01-09T01:35:56.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
34672025-01-09T01:35:56.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34682025-01-09T01:35:56.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34692025-01-09T01:35:56.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702025-01-09T01:35:56.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34712025-01-09T01:35:56.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34722025-01-09T01:35:56.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34732025-01-09T01:35:56.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34742025-01-09T01:35:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34752025-01-09T01:35:56.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34762025-01-09T01:35:56.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34772025-01-09T01:35:56.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782025-01-09T01:35:56.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
34792025-01-09T01:35:56.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34802025-01-09T01:35:56.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34812025-01-09T01:35:56.649ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
34822025-01-09T01:35:56.649ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.081619ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
34832025-01-09T01:35:56.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.828725ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34842025-01-09T01:35:56.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38b3c022-5450-4830-89ce-2937f98d5f94 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34852025-01-09T01:35:56.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38b3c022-5450-4830-89ce-2937f98d5f94 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34862025-01-09T01:35:56.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38b3c022-5450-4830-89ce-2937f98d5f94 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34872025-01-09T01:35:57.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = af812fb8-da0e-40f2-9e93-737bbb6445dd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34882025-01-09T01:35:57.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = af812fb8-da0e-40f2-9e93-737bbb6445dd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34892025-01-09T01:35:57.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = af812fb8-da0e-40f2-9e93-737bbb6445dd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34902025-01-09T01:35:58.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a4f13e0a-6693-4ccb-bf5d-1a3218f9cb1e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34912025-01-09T01:35:58.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a4f13e0a-6693-4ccb-bf5d-1a3218f9cb1e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34922025-01-09T01:35:58.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a4f13e0a-6693-4ccb-bf5d-1a3218f9cb1e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34932025-01-09T01:35:59.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 651 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = f6d8ed87-223d-4272-94cb-dc0463c83d96 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
34942025-01-09T01:35:59.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 34621e9c-3ec6-42b0-aae9-235af4266307 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34952025-01-09T01:35:59.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 34621e9c-3ec6-42b0-aae9-235af4266307 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34962025-01-09T01:35:59.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 34621e9c-3ec6-42b0-aae9-235af4266307 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34972025-01-09T01:36:00.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 26695a77-1488-46eb-b4ac-df4997b58680 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34982025-01-09T01:36:00.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 26695a77-1488-46eb-b4ac-df4997b58680 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34992025-01-09T01:36:00.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 26695a77-1488-46eb-b4ac-df4997b58680 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35002025-01-09T01:36:01.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44d7a7e0-ea26-4fc3-acea-7f3fd3568cd4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35012025-01-09T01:36:01.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44d7a7e0-ea26-4fc3-acea-7f3fd3568cd4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35022025-01-09T01:36:01.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44d7a7e0-ea26-4fc3-acea-7f3fd3568cd4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35032025-01-09T01:36:02.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69f13f53-92df-4e69-9faf-9622a272864c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35042025-01-09T01:36:02.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69f13f53-92df-4e69-9faf-9622a272864c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35052025-01-09T01:36:02.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69f13f53-92df-4e69-9faf-9622a272864c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35062025-01-09T01:36:03.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1ed0abed-40bf-4036-98ab-f6188849fe19 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35072025-01-09T01:36:03.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1ed0abed-40bf-4036-98ab-f6188849fe19 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35082025-01-09T01:36:03.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1ed0abed-40bf-4036-98ab-f6188849fe19 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35092025-01-09T01:36:04.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8450372a-a251-4de1-b181-b3cade9fa513 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35102025-01-09T01:36:04.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8450372a-a251-4de1-b181-b3cade9fa513 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35112025-01-09T01:36:04.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8450372a-a251-4de1-b181-b3cade9fa513 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35122025-01-09T01:36:05.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 683aba77-712f-47f7-8d56-0e24e06f6dd2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35132025-01-09T01:36:05.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 683aba77-712f-47f7-8d56-0e24e06f6dd2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35142025-01-09T01:36:05.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 683aba77-712f-47f7-8d56-0e24e06f6dd2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35152025-01-09T01:36:06.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
35162025-01-09T01:36:06.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35172025-01-09T01:36:06.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35182025-01-09T01:36:06.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
35192025-01-09T01:36:06.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35202025-01-09T01:36:06.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35212025-01-09T01:36:06.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35222025-01-09T01:36:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35232025-01-09T01:36:06.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35242025-01-09T01:36:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35252025-01-09T01:36:06.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35262025-01-09T01:36:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35272025-01-09T01:36:06.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35282025-01-09T01:36:06.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
35292025-01-09T01:36:06.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35302025-01-09T01:36:06.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35312025-01-09T01:36:06.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
35322025-01-09T01:36:06.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.185389ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
35332025-01-09T01:36:06.629ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35342025-01-09T01:36:06.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35352025-01-09T01:36:06.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.421023ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35362025-01-09T01:36:07.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5f337b4-4ac7-46a2-85e1-f094190678c5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35372025-01-09T01:36:07.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5f337b4-4ac7-46a2-85e1-f094190678c5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35382025-01-09T01:36:07.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5f337b4-4ac7-46a2-85e1-f094190678c5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35392025-01-09T01:36:08.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60593d23-e134-435f-ba78-bd1f980094be roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35402025-01-09T01:36:08.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60593d23-e134-435f-ba78-bd1f980094be resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35412025-01-09T01:36:08.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60593d23-e134-435f-ba78-bd1f980094be response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35422025-01-09T01:36:09.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a3de5e3-1674-49ea-abf3-194466262cc2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35432025-01-09T01:36:09.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a3de5e3-1674-49ea-abf3-194466262cc2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35442025-01-09T01:36:09.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a3de5e3-1674-49ea-abf3-194466262cc2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35452025-01-09T01:36:09.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 907 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 68948e79-765e-4552-b7ff-75a3c07ed843 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
35462025-01-09T01:36:10.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e8342f9-626f-4339-83f9-d70676da30b3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35472025-01-09T01:36:10.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e8342f9-626f-4339-83f9-d70676da30b3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35482025-01-09T01:36:10.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e8342f9-626f-4339-83f9-d70676da30b3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35492025-01-09T01:36:11.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4c32664-dfcd-4b2e-8dce-e86c7e3f5d24 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35502025-01-09T01:36:11.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4c32664-dfcd-4b2e-8dce-e86c7e3f5d24 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35512025-01-09T01:36:11.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4c32664-dfcd-4b2e-8dce-e86c7e3f5d24 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35522025-01-09T01:36:12.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd47465d-d099-4165-b566-43a2c4ecadf2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35532025-01-09T01:36:12.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd47465d-d099-4165-b566-43a2c4ecadf2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35542025-01-09T01:36:12.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd47465d-d099-4165-b566-43a2c4ecadf2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35552025-01-09T01:36:13.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06cc11e0-8426-4f90-80ab-2e47c522630c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35562025-01-09T01:36:13.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06cc11e0-8426-4f90-80ab-2e47c522630c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35572025-01-09T01:36:13.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06cc11e0-8426-4f90-80ab-2e47c522630c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35582025-01-09T01:36:14.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 32b4a43a-7e25-45a6-8917-9ec9a3bb34c3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35592025-01-09T01:36:14.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 32b4a43a-7e25-45a6-8917-9ec9a3bb34c3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35602025-01-09T01:36:14.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 32b4a43a-7e25-45a6-8917-9ec9a3bb34c3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35612025-01-09T01:36:14.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 18ef74cb-b054-4b6e-abe1-68d79251a42e roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
35622025-01-09T01:36:14.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 18ef74cb-b054-4b6e-abe1-68d79251a42e resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
35632025-01-09T01:36:14.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 18ef74cb-b054-4b6e-abe1-68d79251a42e response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
35642025-01-09T01:36:14.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d1455c31-9bd8-46d0-bdd5-1a5e2bf7f54a roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
35652025-01-09T01:36:14.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d1455c31-9bd8-46d0-bdd5-1a5e2bf7f54a resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
35662025-01-09T01:36:14.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d1455c31-9bd8-46d0-bdd5-1a5e2bf7f54a response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
35672025-01-09T01:36:15.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6dab38a8-b325-47b2-90b2-fc807b6849dd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35682025-01-09T01:36:15.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6dab38a8-b325-47b2-90b2-fc807b6849dd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35692025-01-09T01:36:15.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6dab38a8-b325-47b2-90b2-fc807b6849dd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35702025-01-09T01:36:16.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe5b0d33-0490-4afe-ac1a-dac28a7bf0ad roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35712025-01-09T01:36:16.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe5b0d33-0490-4afe-ac1a-dac28a7bf0ad resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35722025-01-09T01:36:16.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe5b0d33-0490-4afe-ac1a-dac28a7bf0ad response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35732025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
35742025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
35752025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35762025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
35772025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35782025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35792025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
35802025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
35812025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35822025-01-09T01:36:16.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35832025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35842025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35852025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
35862025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
35872025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35882025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35892025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
35902025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
35912025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
35922025-01-09T01:36:16.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35932025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
35942025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35952025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35962025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
35972025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35982025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
35992025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36002025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36012025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36022025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36032025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36042025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36052025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36062025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36072025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36082025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36092025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36102025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36112025-01-09T01:36:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36122025-01-09T01:36:16.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36132025-01-09T01:36:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
36142025-01-09T01:36:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
36152025-01-09T01:36:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36162025-01-09T01:36:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36172025-01-09T01:36:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36182025-01-09T01:36:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36192025-01-09T01:36:16.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36212025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36222025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36232025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
36242025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36252025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
36262025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36272025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.859723ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36282025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36292025-01-09T01:36:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36302025-01-09T01:36:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36312025-01-09T01:36:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36322025-01-09T01:36:16.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36332025-01-09T01:36:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36342025-01-09T01:36:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36352025-01-09T01:36:16.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36362025-01-09T01:36:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36372025-01-09T01:36:16.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36382025-01-09T01:36:16.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1109, tv_nsec: 15416879 } })
36392025-01-09T01:36:16.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36402025-01-09T01:36:16.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
36412025-01-09T01:36:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36422025-01-09T01:36:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36432025-01-09T01:36:16.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36442025-01-09T01:36:16.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1109, tv_nsec: 16721890 } })
36452025-01-09T01:36:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36462025-01-09T01:36:16.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
36472025-01-09T01:36:16.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36482025-01-09T01:36:16.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.869963ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
36492025-01-09T01:36:16.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36502025-01-09T01:36:16.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36512025-01-09T01:36:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36522025-01-09T01:36:16.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36532025-01-09T01:36:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36542025-01-09T01:36:16.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36552025-01-09T01:36:16.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36562025-01-09T01:36:16.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1109, tv_nsec: 24959362 } })
36572025-01-09T01:36:16.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
36582025-01-09T01:36:16.636ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36592025-01-09T01:36:16.636ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36602025-01-09T01:36:16.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36612025-01-09T01:36:16.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36622025-01-09T01:36:16.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36632025-01-09T01:36:16.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36642025-01-09T01:36:16.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36652025-01-09T01:36:16.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36662025-01-09T01:36:16.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36672025-01-09T01:36:16.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36682025-01-09T01:36:16.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.201322ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
36692025-01-09T01:36:16.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36702025-01-09T01:36:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36712025-01-09T01:36:16.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.71989ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36722025-01-09T01:36:16.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36732025-01-09T01:36:16.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36742025-01-09T01:36:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36752025-01-09T01:36:16.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36762025-01-09T01:36:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36772025-01-09T01:36:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36782025-01-09T01:36:16.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36792025-01-09T01:36:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36802025-01-09T01:36:16.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36812025-01-09T01:36:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36822025-01-09T01:36:16.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36832025-01-09T01:36:16.731ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36842025-01-09T01:36:16.731ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4900a037-9976-4764-a6ef-6280c2c5a3cb", "content-length": "26", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
36852025-01-09T01:36:16.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36862025-01-09T01:36:16.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36872025-01-09T01:36:16.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36882025-01-09T01:36:16.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36892025-01-09T01:36:16.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36902025-01-09T01:36:16.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36912025-01-09T01:36:16.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
36922025-01-09T01:36:16.753ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36932025-01-09T01:36:16.753ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00f5665e-44b6-4697-94b1-40c5500784af", "content-length": "26", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
36942025-01-09T01:36:16.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36952025-01-09T01:36:16.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
36962025-01-09T01:36:16.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36972025-01-09T01:36:16.809ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36982025-01-09T01:36:16.809ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "efcf98ad-8953-4aca-b30b-c67ee7b95085", "content-length": "26", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
36992025-01-09T01:36:16.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37002025-01-09T01:36:16.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37012025-01-09T01:36:16.827ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37022025-01-09T01:36:16.827ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37032025-01-09T01:36:16.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c87a1695-7906-46c2-bc1a-12feb967729f", "content-length": "372", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37042025-01-09T01:36:16.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37052025-01-09T01:36:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37062025-01-09T01:36:16.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37072025-01-09T01:36:16.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37082025-01-09T01:36:16.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 231.285401ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37092025-01-09T01:36:16.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37102025-01-09T01:36:16.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37112025-01-09T01:36:16.838ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.280261ms iteration = 6 status = {}
37122025-01-09T01:36:16.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 266.10365ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37132025-01-09T01:36:16.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37142025-01-09T01:36:16.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 268.55173ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37152025-01-09T01:36:16.873ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37162025-01-09T01:36:16.873ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37172025-01-09T01:36:16.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37182025-01-09T01:36:16.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37192025-01-09T01:36:16.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37202025-01-09T01:36:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37212025-01-09T01:36:16.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37222025-01-09T01:36:16.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37232025-01-09T01:36:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
37242025-01-09T01:36:16.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37252025-01-09T01:36:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37262025-01-09T01:36:16.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
37272025-01-09T01:36:16.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37282025-01-09T01:36:16.887ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37292025-01-09T01:36:16.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37302025-01-09T01:36:16.887ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c63116d0-fcb3-4e9f-9cb0-d00beb40afaa", "content-length": "1", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37312025-01-09T01:36:16.889ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37322025-01-09T01:36:16.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37332025-01-09T01:36:16.889ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 288.155525ms iteration = 6 status = 0
37342025-01-09T01:36:16.894ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.881061ms iteration = 6 status = null
37352025-01-09T01:36:16.900ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37362025-01-09T01:36:16.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37372025-01-09T01:36:16.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eb6f592e-1c55-4457-9aba-0e381cede894", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37382025-01-09T01:36:16.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37392025-01-09T01:36:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37402025-01-09T01:36:16.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37412025-01-09T01:36:16.902ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
37422025-01-09T01:36:16.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 300.937461ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
37432025-01-09T01:36:16.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37442025-01-09T01:36:16.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37452025-01-09T01:36:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37462025-01-09T01:36:16.910ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37472025-01-09T01:36:16.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37482025-01-09T01:36:16.910ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d5a698c3-2150-4789-ac98-d4a76554530f", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37492025-01-09T01:36:16.912ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 310.603586ms iteration = 6 status = {}
37502025-01-09T01:36:16.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 309.734083ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37512025-01-09T01:36:16.922ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37522025-01-09T01:36:16.922ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37532025-01-09T01:36:16.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 320.989923ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37542025-01-09T01:36:16.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37552025-01-09T01:36:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37562025-01-09T01:36:16.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 349.043825ms iteration = 8 status = {"physical_disks_added":0}
37572025-01-09T01:36:16.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37582025-01-09T01:36:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592025-01-09T01:36:16.967ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
37602025-01-09T01:36:16.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37612025-01-09T01:36:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37622025-01-09T01:36:16.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632025-01-09T01:36:16.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37642025-01-09T01:36:16.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37652025-01-09T01:36:16.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37662025-01-09T01:36:16.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37672025-01-09T01:36:16.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37682025-01-09T01:36:16.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37692025-01-09T01:36:16.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37702025-01-09T01:36:17.076ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37712025-01-09T01:36:17.076ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c34a32ff-2142-4cc2-8a74-a1936674d2d3", "content-length": "134", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37722025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37732025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
37742025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37752025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37762025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37772025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37782025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37792025-01-09T01:36:17.076ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37802025-01-09T01:36:17.077ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37812025-01-09T01:36:17.077ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37822025-01-09T01:36:17.077ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
37832025-01-09T01:36:17.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37842025-01-09T01:36:17.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37852025-01-09T01:36:17.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37862025-01-09T01:36:17.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b333f1af-b576-44a6-bfd1-2518a129acd2", "content-length": "2", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37872025-01-09T01:36:17.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37882025-01-09T01:36:17.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4a7d41e-7619-4ddd-825e-f13f753e3b4c", "content-length": "52", "date": "Thu, 09 Jan 2025 01:36:16 GMT"} })
37892025-01-09T01:36:17.085ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
37902025-01-09T01:36:17.085ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37912025-01-09T01:36:17.098ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37922025-01-09T01:36:17.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe94d3e-cfae-4694-9414-6fa6ca2d2c67", "content-length": "691", "date": "Thu, 09 Jan 2025 01:36:17 GMT"} })
37932025-01-09T01:36:17.177ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37942025-01-09T01:36:17.177ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37952025-01-09T01:36:17.177ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37962025-01-09T01:36:17.178ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 576.880709ms iteration = 6 status = {}
37972025-01-09T01:36:17.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b13c83db-7edc-4530-82cc-4b18fb1d1919 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
37982025-01-09T01:36:17.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b13c83db-7edc-4530-82cc-4b18fb1d1919 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
37992025-01-09T01:36:17.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b13c83db-7edc-4530-82cc-4b18fb1d1919 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38002025-01-09T01:36:17.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f9a246d9-5742-46eb-8b42-6d983e9efbe5", "date": "Thu, 09 Jan 2025 01:36:17 GMT"} })
38012025-01-09T01:36:17.276ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
38022025-01-09T01:36:17.276ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38032025-01-09T01:36:17.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2147a533-97c5-4f17-846a-f12eb66681b3", "content-length": "682", "date": "Thu, 09 Jan 2025 01:36:17 GMT"} })
38042025-01-09T01:36:17.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38052025-01-09T01:36:17.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38062025-01-09T01:36:17.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38072025-01-09T01:36:17.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38082025-01-09T01:36:17.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38092025-01-09T01:36:17.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38102025-01-09T01:36:17.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38112025-01-09T01:36:17.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38122025-01-09T01:36:17.382ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 780.732588ms iteration = 6 status = {}
38132025-01-09T01:36:17.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3370af8d-d8b0-4233-a112-5fa35117d197 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
38142025-01-09T01:36:17.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3370af8d-d8b0-4233-a112-5fa35117d197 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
38152025-01-09T01:36:17.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 3370af8d-d8b0-4233-a112-5fa35117d197 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
38162025-01-09T01:36:18.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 586475cc-e0bf-417a-a985-e6cf5e73cded roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38172025-01-09T01:36:18.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 586475cc-e0bf-417a-a985-e6cf5e73cded resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38182025-01-09T01:36:18.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 586475cc-e0bf-417a-a985-e6cf5e73cded response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38192025-01-09T01:36:19.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b5fdad4d-6a9e-4dba-9fb6-a41a4919f55d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38202025-01-09T01:36:19.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b5fdad4d-6a9e-4dba-9fb6-a41a4919f55d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38212025-01-09T01:36:19.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b5fdad4d-6a9e-4dba-9fb6-a41a4919f55d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38222025-01-09T01:36:19.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 540 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 7af43f1d-b362-44ad-aaad-bff7342fe63b response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
38232025-01-09T01:36:20.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e34f159-962d-4965-8551-455cd61f6ae1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38242025-01-09T01:36:20.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e34f159-962d-4965-8551-455cd61f6ae1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38252025-01-09T01:36:20.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e34f159-962d-4965-8551-455cd61f6ae1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38262025-01-09T01:36:21.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f19aa8bd-f7c1-44dc-94cb-7ea23bd28c82 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38272025-01-09T01:36:21.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f19aa8bd-f7c1-44dc-94cb-7ea23bd28c82 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38282025-01-09T01:36:21.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f19aa8bd-f7c1-44dc-94cb-7ea23bd28c82 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38292025-01-09T01:36:22.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c541a8a3-51a6-4de4-918f-f230ae51603b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38302025-01-09T01:36:22.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c541a8a3-51a6-4de4-918f-f230ae51603b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38312025-01-09T01:36:22.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c541a8a3-51a6-4de4-918f-f230ae51603b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38322025-01-09T01:36:23.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc4f2e34-8add-4b94-b7f3-8012b607ecf1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38332025-01-09T01:36:23.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc4f2e34-8add-4b94-b7f3-8012b607ecf1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38342025-01-09T01:36:23.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc4f2e34-8add-4b94-b7f3-8012b607ecf1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38352025-01-09T01:36:24.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0b9a0f7c-b220-4b07-b8e6-842a7d789242 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38362025-01-09T01:36:24.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0b9a0f7c-b220-4b07-b8e6-842a7d789242 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38372025-01-09T01:36:24.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0b9a0f7c-b220-4b07-b8e6-842a7d789242 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38382025-01-09T01:36:25.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b189ced-35ec-497b-8403-73332b624d72 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38392025-01-09T01:36:25.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b189ced-35ec-497b-8403-73332b624d72 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38402025-01-09T01:36:25.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b189ced-35ec-497b-8403-73332b624d72 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38412025-01-09T01:36:26.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b8e4bf09-6910-4746-84e6-4ed1e01e8d30 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38422025-01-09T01:36:26.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b8e4bf09-6910-4746-84e6-4ed1e01e8d30 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38432025-01-09T01:36:26.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b8e4bf09-6910-4746-84e6-4ed1e01e8d30 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38442025-01-09T01:36:26.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
38452025-01-09T01:36:26.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38462025-01-09T01:36:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38472025-01-09T01:36:26.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
38482025-01-09T01:36:26.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38492025-01-09T01:36:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38502025-01-09T01:36:26.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38512025-01-09T01:36:26.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38522025-01-09T01:36:26.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.897703ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38532025-01-09T01:36:26.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38542025-01-09T01:36:26.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38552025-01-09T01:36:26.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38562025-01-09T01:36:26.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38572025-01-09T01:36:26.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38582025-01-09T01:36:26.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38592025-01-09T01:36:26.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38602025-01-09T01:36:26.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
38612025-01-09T01:36:26.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38622025-01-09T01:36:26.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38632025-01-09T01:36:26.764ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
38642025-01-09T01:36:26.764ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 162.394963ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
38652025-01-09T01:36:27.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83c1d9eb-bec9-482d-85f8-8abe5d0ef074 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38662025-01-09T01:36:27.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83c1d9eb-bec9-482d-85f8-8abe5d0ef074 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38672025-01-09T01:36:27.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83c1d9eb-bec9-482d-85f8-8abe5d0ef074 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38682025-01-09T01:36:28.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 141bb7c5-3d57-436b-9800-a6a97033fabb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38692025-01-09T01:36:28.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 141bb7c5-3d57-436b-9800-a6a97033fabb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38702025-01-09T01:36:28.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 141bb7c5-3d57-436b-9800-a6a97033fabb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38712025-01-09T01:36:29.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 1a2bab35-a161-430e-be11-637d8d9fb92f response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
38722025-01-09T01:36:29.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 55719859-34b1-486e-b237-f2a5ea82d051 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38732025-01-09T01:36:29.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 55719859-34b1-486e-b237-f2a5ea82d051 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38742025-01-09T01:36:29.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 55719859-34b1-486e-b237-f2a5ea82d051 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38752025-01-09T01:36:30.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe8348f0-f25d-4c43-8b7c-188060aec9bd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38762025-01-09T01:36:30.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe8348f0-f25d-4c43-8b7c-188060aec9bd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38772025-01-09T01:36:30.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe8348f0-f25d-4c43-8b7c-188060aec9bd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38782025-01-09T01:36:31.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4bd7cfe-937e-4dd1-a62a-41e525d68528 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38792025-01-09T01:36:31.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4bd7cfe-937e-4dd1-a62a-41e525d68528 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38802025-01-09T01:36:31.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4bd7cfe-937e-4dd1-a62a-41e525d68528 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38812025-01-09T01:36:32.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30ee1515-0351-4abd-94ef-4b27260b18bc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38822025-01-09T01:36:32.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30ee1515-0351-4abd-94ef-4b27260b18bc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38832025-01-09T01:36:32.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30ee1515-0351-4abd-94ef-4b27260b18bc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38842025-01-09T01:36:33.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41a368c1-254e-49d5-8144-6d90d8dda1fe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38852025-01-09T01:36:33.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41a368c1-254e-49d5-8144-6d90d8dda1fe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38862025-01-09T01:36:33.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41a368c1-254e-49d5-8144-6d90d8dda1fe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38872025-01-09T01:36:34.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e27dcc11-ea34-4220-b35c-c86bead8e504 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38882025-01-09T01:36:34.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e27dcc11-ea34-4220-b35c-c86bead8e504 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38892025-01-09T01:36:34.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e27dcc11-ea34-4220-b35c-c86bead8e504 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38902025-01-09T01:36:35.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2f8c1ee9-0f9f-4ee1-8c8b-67f9598dead2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38912025-01-09T01:36:35.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2f8c1ee9-0f9f-4ee1-8c8b-67f9598dead2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38922025-01-09T01:36:35.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2f8c1ee9-0f9f-4ee1-8c8b-67f9598dead2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
38932025-01-09T01:36:36.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
38942025-01-09T01:36:36.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38952025-01-09T01:36:36.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38962025-01-09T01:36:36.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
38972025-01-09T01:36:36.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38982025-01-09T01:36:36.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38992025-01-09T01:36:36.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39002025-01-09T01:36:36.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39012025-01-09T01:36:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39022025-01-09T01:36:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39032025-01-09T01:36:36.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39042025-01-09T01:36:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39052025-01-09T01:36:36.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.25862ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39062025-01-09T01:36:36.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39072025-01-09T01:36:36.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39082025-01-09T01:36:36.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39092025-01-09T01:36:36.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
39102025-01-09T01:36:36.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39112025-01-09T01:36:36.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39122025-01-09T01:36:36.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
39132025-01-09T01:36:36.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.717025ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
39142025-01-09T01:36:36.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bc6d7cf-2551-48f9-b98e-149140bf37bd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39152025-01-09T01:36:36.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bc6d7cf-2551-48f9-b98e-149140bf37bd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39162025-01-09T01:36:36.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bc6d7cf-2551-48f9-b98e-149140bf37bd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39172025-01-09T01:36:37.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 739dd768-45c4-4cc3-9329-d253705cb77e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39182025-01-09T01:36:37.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 739dd768-45c4-4cc3-9329-d253705cb77e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39192025-01-09T01:36:37.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 739dd768-45c4-4cc3-9329-d253705cb77e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39202025-01-09T01:36:38.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17f7b1bb-3859-4c28-b89f-d64978ae129d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39212025-01-09T01:36:38.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17f7b1bb-3859-4c28-b89f-d64978ae129d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39222025-01-09T01:36:38.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17f7b1bb-3859-4c28-b89f-d64978ae129d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39232025-01-09T01:36:39.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 976 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = d5d68c0e-ac8d-49bf-9d32-3204da0cc633 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
39242025-01-09T01:36:39.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a9f8f7eb-ad85-44ce-ba1e-7d41b4077ba3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39252025-01-09T01:36:39.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a9f8f7eb-ad85-44ce-ba1e-7d41b4077ba3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39262025-01-09T01:36:39.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a9f8f7eb-ad85-44ce-ba1e-7d41b4077ba3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39272025-01-09T01:36:40.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6556dfea-f110-40d2-8151-8eef8baa7289 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39282025-01-09T01:36:40.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6556dfea-f110-40d2-8151-8eef8baa7289 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39292025-01-09T01:36:40.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6556dfea-f110-40d2-8151-8eef8baa7289 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39302025-01-09T01:36:41.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a9c0262-fbd8-4104-9e66-880ee762c3a7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39312025-01-09T01:36:41.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a9c0262-fbd8-4104-9e66-880ee762c3a7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39322025-01-09T01:36:41.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a9c0262-fbd8-4104-9e66-880ee762c3a7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39332025-01-09T01:36:42.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 604a7189-2a0c-49a0-b4d4-5a3995c0e236 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39342025-01-09T01:36:42.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 604a7189-2a0c-49a0-b4d4-5a3995c0e236 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39352025-01-09T01:36:42.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 604a7189-2a0c-49a0-b4d4-5a3995c0e236 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39362025-01-09T01:36:43.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a8c63ab4-6ad2-4c86-8fcb-358d725b7918 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39372025-01-09T01:36:43.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a8c63ab4-6ad2-4c86-8fcb-358d725b7918 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39382025-01-09T01:36:43.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a8c63ab4-6ad2-4c86-8fcb-358d725b7918 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39392025-01-09T01:36:44.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60985238-0503-49f3-a74a-325c78a900e9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39402025-01-09T01:36:44.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60985238-0503-49f3-a74a-325c78a900e9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39412025-01-09T01:36:44.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60985238-0503-49f3-a74a-325c78a900e9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39422025-01-09T01:36:45.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d9cda27-97e0-4968-b697-5593ba7a603b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39432025-01-09T01:36:45.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d9cda27-97e0-4968-b697-5593ba7a603b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39442025-01-09T01:36:45.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d9cda27-97e0-4968-b697-5593ba7a603b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
39452025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
39462025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
39472025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
39482025-01-09T01:36:46.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
39492025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39502025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
39512025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.45\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
39522025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
39532025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
39542025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39552025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39562025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
39572025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
39582025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
39592025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39602025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39612025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39622025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
39632025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
39642025-01-09T01:36:46.601ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:26:46.601859176 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39652025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
39662025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39672025-01-09T01:36:46.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39682025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39692025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
39702025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39712025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39722025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39732025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39742025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39752025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39762025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39772025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
39782025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
39792025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39802025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
39812025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39822025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
39832025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39842025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39852025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
39862025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
39872025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39882025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
39892025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39902025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39912025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
39922025-01-09T01:36:46.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39932025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
39942025-01-09T01:36:46.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39952025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39962025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
39972025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39982025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39992025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
40002025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40012025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40022025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
40032025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40042025-01-09T01:36:46.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 5489179 } })
40052025-01-09T01:36:46.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 5496829 } })
40062025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40072025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40082025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40092025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40102025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40112025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40122025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40132025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40142025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40152025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40162025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40172025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40182025-01-09T01:36:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40192025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40202025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40212025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
40222025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.296891ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
40232025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40242025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40252025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
40262025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.449943ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
40272025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40282025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40292025-01-09T01:36:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40302025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40312025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
40322025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40332025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
40342025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40352025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
40362025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40372025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
40382025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40392025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40402025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40412025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40422025-01-09T01:36:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40432025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40452025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40462025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40472025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
40482025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40492025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40502025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40512025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40522025-01-09T01:36:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.027695ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40532025-01-09T01:36:46.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 9103497 } })
40542025-01-09T01:36:46.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40552025-01-09T01:36:46.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 9439252 } })
40562025-01-09T01:36:46.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40572025-01-09T01:36:46.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40582025-01-09T01:36:46.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40592025-01-09T01:36:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40602025-01-09T01:36:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40612025-01-09T01:36:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40622025-01-09T01:36:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40632025-01-09T01:36:46.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40642025-01-09T01:36:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40652025-01-09T01:36:46.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40662025-01-09T01:36:46.610ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:26:46.601859176 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40672025-01-09T01:36:46.610ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.648139ms iteration = 4 status = {"expiration":"2025-01-09T01:26:46.601859176Z","pruned":[]}
40682025-01-09T01:36:46.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692025-01-09T01:36:46.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702025-01-09T01:36:46.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40712025-01-09T01:36:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40722025-01-09T01:36:46.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40732025-01-09T01:36:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40742025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40752025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40762025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40772025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40782025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40792025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40802025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40812025-01-09T01:36:46.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40822025-01-09T01:36:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40832025-01-09T01:36:46.617ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40842025-01-09T01:36:46.617ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40852025-01-09T01:36:46.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40862025-01-09T01:36:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40872025-01-09T01:36:46.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40882025-01-09T01:36:46.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892025-01-09T01:36:46.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902025-01-09T01:36:46.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40912025-01-09T01:36:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40922025-01-09T01:36:46.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40932025-01-09T01:36:46.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40942025-01-09T01:36:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40952025-01-09T01:36:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40962025-01-09T01:36:46.621ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40972025-01-09T01:36:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40982025-01-09T01:36:46.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.893424ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
40992025-01-09T01:36:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41002025-01-09T01:36:46.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41012025-01-09T01:36:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41022025-01-09T01:36:46.623ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.584505ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
41032025-01-09T01:36:46.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.974661ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
41042025-01-09T01:36:46.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41052025-01-09T01:36:46.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062025-01-09T01:36:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41072025-01-09T01:36:46.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41082025-01-09T01:36:46.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41092025-01-09T01:36:46.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41102025-01-09T01:36:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41112025-01-09T01:36:46.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1139, tv_nsec: 32934730 } })
41122025-01-09T01:36:46.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
41132025-01-09T01:36:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41142025-01-09T01:36:46.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41152025-01-09T01:36:46.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41162025-01-09T01:36:46.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41172025-01-09T01:36:46.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41182025-01-09T01:36:46.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41192025-01-09T01:36:46.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
41202025-01-09T01:36:46.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41212025-01-09T01:36:46.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41222025-01-09T01:36:46.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41232025-01-09T01:36:46.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41242025-01-09T01:36:46.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41252025-01-09T01:36:46.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41262025-01-09T01:36:46.662ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41272025-01-09T01:36:46.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282025-01-09T01:36:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41292025-01-09T01:36:46.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41302025-01-09T01:36:46.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41312025-01-09T01:36:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41322025-01-09T01:36:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41332025-01-09T01:36:46.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41342025-01-09T01:36:46.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41352025-01-09T01:36:46.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41362025-01-09T01:36:46.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41372025-01-09T01:36:46.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41382025-01-09T01:36:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41392025-01-09T01:36:46.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41402025-01-09T01:36:46.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41412025-01-09T01:36:46.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41422025-01-09T01:36:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41432025-01-09T01:36:46.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41442025-01-09T01:36:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41452025-01-09T01:36:46.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41462025-01-09T01:36:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41472025-01-09T01:36:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41482025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41492025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41502025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41512025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41522025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41532025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41542025-01-09T01:36:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41552025-01-09T01:36:46.682ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41562025-01-09T01:36:46.682ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41572025-01-09T01:36:46.682ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.883662ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41582025-01-09T01:36:46.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.503119ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41592025-01-09T01:36:46.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41602025-01-09T01:36:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41612025-01-09T01:36:46.694ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41622025-01-09T01:36:46.694ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41632025-01-09T01:36:46.694ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41642025-01-09T01:36:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41652025-01-09T01:36:46.698ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41662025-01-09T01:36:46.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.456962ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41672025-01-09T01:36:46.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41682025-01-09T01:36:46.709ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41692025-01-09T01:36:46.709ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41702025-01-09T01:36:46.709ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.736967ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41712025-01-09T01:36:46.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41722025-01-09T01:36:46.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41732025-01-09T01:36:46.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41742025-01-09T01:36:46.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41752025-01-09T01:36:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41762025-01-09T01:36:46.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772025-01-09T01:36:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41782025-01-09T01:36:46.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41792025-01-09T01:36:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41802025-01-09T01:36:46.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 126.584837ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41812025-01-09T01:36:46.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41822025-01-09T01:36:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41832025-01-09T01:36:46.735ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41842025-01-09T01:36:46.735ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41852025-01-09T01:36:46.735ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.01826ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41862025-01-09T01:36:46.736ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41872025-01-09T01:36:46.736ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41882025-01-09T01:36:46.736ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41892025-01-09T01:36:46.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41902025-01-09T01:36:46.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41912025-01-09T01:36:46.769ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41922025-01-09T01:36:46.776ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41932025-01-09T01:36:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41942025-01-09T01:36:46.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41952025-01-09T01:36:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41962025-01-09T01:36:46.785ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41972025-01-09T01:36:46.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
41982025-01-09T01:36:46.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 184.710872ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
41992025-01-09T01:36:46.790ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.030185ms iteration = 9 status = {"physical_disks_added":0}
42002025-01-09T01:36:46.795ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42012025-01-09T01:36:46.795ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42022025-01-09T01:36:46.795ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1ebabd3-42d7-4603-8dd1-07e605c1eb0d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
42032025-01-09T01:36:46.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42042025-01-09T01:36:46.797ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42052025-01-09T01:36:46.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42062025-01-09T01:36:46.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42072025-01-09T01:36:46.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a8e11cf-215b-4e8f-97ad-dd348f4fab39 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
42082025-01-09T01:36:46.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a8e11cf-215b-4e8f-97ad-dd348f4fab39 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
42092025-01-09T01:36:46.988ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42102025-01-09T01:36:46.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42112025-01-09T01:36:46.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7356a0ce-6cbf-4af1-89b7-5d5b9edc25f0", "content-length": "372", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
42122025-01-09T01:36:46.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42132025-01-09T01:36:46.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42142025-01-09T01:36:46.991ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42152025-01-09T01:36:46.991ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42162025-01-09T01:36:46.991ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19308427-4feb-4eea-a18a-9b2aeb30233c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
42172025-01-09T01:36:46.991ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42182025-01-09T01:36:46.993ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42192025-01-09T01:36:47.012ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42202025-01-09T01:36:47.018ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42212025-01-09T01:36:47.018ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1738b37a-e96a-42d5-a388-3a94587e490d", "content-length": "1", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
42222025-01-09T01:36:47.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42232025-01-09T01:36:47.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e964bef4-4b18-4d3a-ab90-95076be817f9", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42242025-01-09T01:36:47.019ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42252025-01-09T01:36:47.021ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42262025-01-09T01:36:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42272025-01-09T01:36:47.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "464e922b-fbf3-4a13-a4bb-5d1db83b613c", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42282025-01-09T01:36:47.022ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42292025-01-09T01:36:47.023ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42302025-01-09T01:36:47.023ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 422.024929ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42312025-01-09T01:36:47.048ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
42322025-01-09T01:36:47.048ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42332025-01-09T01:36:47.048ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "39644eaf-2501-4eae-884f-9eeb50a899f9", "content-length": "26", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
42342025-01-09T01:36:47.048ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42352025-01-09T01:36:47.050ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
42362025-01-09T01:36:47.055ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
42372025-01-09T01:36:47.056ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f0a30d3-e872-49e1-845c-c23471d33bcf", "content-length": "64", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
42382025-01-09T01:36:47.056ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42392025-01-09T01:36:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42402025-01-09T01:36:47.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42412025-01-09T01:36:47.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42422025-01-09T01:36:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42432025-01-09T01:36:47.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42442025-01-09T01:36:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42452025-01-09T01:36:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42462025-01-09T01:36:47.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a8e11cf-215b-4e8f-97ad-dd348f4fab39 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
42472025-01-09T01:36:47.066ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.99314ms iteration = 7 status = null
42482025-01-09T01:36:47.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42492025-01-09T01:36:47.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
42502025-01-09T01:36:47.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42512025-01-09T01:36:47.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42522025-01-09T01:36:47.079ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 476.945032ms iteration = 7 status = 0
42532025-01-09T01:36:47.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 498.654982ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42542025-01-09T01:36:47.104ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42552025-01-09T01:36:47.104ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42562025-01-09T01:36:47.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42572025-01-09T01:36:47.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42582025-01-09T01:36:47.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42592025-01-09T01:36:47.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 505.126045ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42602025-01-09T01:36:47.109ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42612025-01-09T01:36:47.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42622025-01-09T01:36:47.110ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42632025-01-09T01:36:47.110ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
42642025-01-09T01:36:47.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42652025-01-09T01:36:47.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42662025-01-09T01:36:47.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42672025-01-09T01:36:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42682025-01-09T01:36:47.111ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42692025-01-09T01:36:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42702025-01-09T01:36:47.111ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 509.527836ms iteration = 7 status = {}
42712025-01-09T01:36:47.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42722025-01-09T01:36:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42732025-01-09T01:36:47.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42742025-01-09T01:36:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42752025-01-09T01:36:47.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42762025-01-09T01:36:47.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42772025-01-09T01:36:47.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42782025-01-09T01:36:47.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42792025-01-09T01:36:47.116ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42802025-01-09T01:36:47.116ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42812025-01-09T01:36:47.116ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
42822025-01-09T01:36:47.116ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 514.472146ms iteration = 4 status = {"generation":1}
42832025-01-09T01:36:47.116ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 514.361524ms iteration = 3 status = {"nsuccess":5}
42842025-01-09T01:36:47.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42852025-01-09T01:36:47.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42862025-01-09T01:36:47.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42872025-01-09T01:36:47.121ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42882025-01-09T01:36:47.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "590c4e2a-2566-4561-8027-43a9d5ae5679", "date": "Thu, 09 Jan 2025 01:36:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42892025-01-09T01:36:47.121ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42902025-01-09T01:36:47.123ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5d5fadc4-fcbc-445f-b016-321fc52dbe19", "date": "Thu, 09 Jan 2025 01:36:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42912025-01-09T01:36:47.124ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42922025-01-09T01:36:47.124ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
42932025-01-09T01:36:47.124ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42942025-01-09T01:36:47.124ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
42952025-01-09T01:36:47.124ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 522.564585ms iteration = 4 status = {"generation":2}
42962025-01-09T01:36:47.125ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d90f23bf-3950-4383-ab74-a8495f3190c1", "date": "Thu, 09 Jan 2025 01:36:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42972025-01-09T01:36:47.125ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42982025-01-09T01:36:47.127ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42992025-01-09T01:36:47.127ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 525.422952ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43002025-01-09T01:36:47.130ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43012025-01-09T01:36:47.130ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43022025-01-09T01:36:47.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e63e47f3-5b77-497e-aa27-eeb569f6fd8b", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43032025-01-09T01:36:47.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43042025-01-09T01:36:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43052025-01-09T01:36:47.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43062025-01-09T01:36:47.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43072025-01-09T01:36:47.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43082025-01-09T01:36:47.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43092025-01-09T01:36:47.144ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43102025-01-09T01:36:47.144ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43112025-01-09T01:36:47.144ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "63b5f4a5-e598-4f18-8f87-f506fabafa98", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43122025-01-09T01:36:47.147ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 544.661741ms iteration = 7 status = {}
43132025-01-09T01:36:47.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43142025-01-09T01:36:47.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43152025-01-09T01:36:47.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43162025-01-09T01:36:47.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43172025-01-09T01:36:47.155ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43182025-01-09T01:36:47.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43192025-01-09T01:36:47.157ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43202025-01-09T01:36:47.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43212025-01-09T01:36:47.193ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43222025-01-09T01:36:47.193ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 590.906465ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43232025-01-09T01:36:47.208ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
43242025-01-09T01:36:47.208ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 606.525277ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43252025-01-09T01:36:47.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43262025-01-09T01:36:47.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43272025-01-09T01:36:47.215ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
43282025-01-09T01:36:47.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43292025-01-09T01:36:47.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43302025-01-09T01:36:47.261ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43312025-01-09T01:36:47.261ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0d7bcff-93c2-491e-bd9f-fcc2d1d83aa4", "content-length": "691", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43322025-01-09T01:36:47.261ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43332025-01-09T01:36:47.261ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43342025-01-09T01:36:47.261ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43352025-01-09T01:36:47.262ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 659.931955ms iteration = 7 status = {}
43362025-01-09T01:36:47.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43372025-01-09T01:36:47.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3250dbc1-5ba9-4cc5-9752-ef6e7e328b02", "content-length": "134", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43382025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43392025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
43402025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43412025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43422025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43432025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43442025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43452025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43462025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43472025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43482025-01-09T01:36:47.328ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
43492025-01-09T01:36:47.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43502025-01-09T01:36:47.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43512025-01-09T01:36:47.330ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43522025-01-09T01:36:47.330ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ba23af5-0bcd-406e-bc99-ad030d1121c3", "content-length": "2", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43532025-01-09T01:36:47.330ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43542025-01-09T01:36:47.330ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "784714cf-9cbc-4033-b4c3-c470f7f35ae6", "content-length": "52", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43552025-01-09T01:36:47.330ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
43562025-01-09T01:36:47.330ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43572025-01-09T01:36:47.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "24dd5500-3b7e-4819-a189-2311737b7e92", "date": "Thu, 09 Jan 2025 01:36:46 GMT"} })
43582025-01-09T01:36:47.483ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
43592025-01-09T01:36:47.483ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43602025-01-09T01:36:47.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "633c3af9-316f-435f-b701-bc78f508588f", "content-length": "682", "date": "Thu, 09 Jan 2025 01:36:47 GMT"} })
43612025-01-09T01:36:47.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43622025-01-09T01:36:47.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43632025-01-09T01:36:47.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43642025-01-09T01:36:47.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43652025-01-09T01:36:47.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43662025-01-09T01:36:47.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43672025-01-09T01:36:47.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43682025-01-09T01:36:47.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43692025-01-09T01:36:47.504ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 902.124382ms iteration = 7 status = {}
43702025-01-09T01:36:47.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a0f926c1-92e0-4001-8194-901563165526 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
43712025-01-09T01:36:47.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a0f926c1-92e0-4001-8194-901563165526 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
43722025-01-09T01:36:47.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = a0f926c1-92e0-4001-8194-901563165526 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
43732025-01-09T01:36:48.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 796be3b0-1d34-4aa3-8ec4-0e6a771e7e96 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43742025-01-09T01:36:48.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 796be3b0-1d34-4aa3-8ec4-0e6a771e7e96 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43752025-01-09T01:36:48.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 796be3b0-1d34-4aa3-8ec4-0e6a771e7e96 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43762025-01-09T01:36:49.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e76d1200-9c80-4bd3-ad60-d146e34afc88 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43772025-01-09T01:36:49.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e76d1200-9c80-4bd3-ad60-d146e34afc88 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43782025-01-09T01:36:49.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e76d1200-9c80-4bd3-ad60-d146e34afc88 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43792025-01-09T01:36:49.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = b7a28a56-c434-44d1-a43e-54cbb3de586b response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
43802025-01-09T01:36:50.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c4bb894f-da71-4baa-a185-2f8639c99c47 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43812025-01-09T01:36:50.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c4bb894f-da71-4baa-a185-2f8639c99c47 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43822025-01-09T01:36:50.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c4bb894f-da71-4baa-a185-2f8639c99c47 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43832025-01-09T01:36:51.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aec5dd43-a29c-4c20-aa3d-426c47d08a25 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43842025-01-09T01:36:51.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aec5dd43-a29c-4c20-aa3d-426c47d08a25 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43852025-01-09T01:36:51.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aec5dd43-a29c-4c20-aa3d-426c47d08a25 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43862025-01-09T01:36:52.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fa39e4db-25d0-4799-b93d-22acf2f76b22 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43872025-01-09T01:36:52.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fa39e4db-25d0-4799-b93d-22acf2f76b22 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43882025-01-09T01:36:52.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fa39e4db-25d0-4799-b93d-22acf2f76b22 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43892025-01-09T01:36:53.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f6c8d3b1-9e9f-4eda-b2fa-4bafd11f9780 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43902025-01-09T01:36:53.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f6c8d3b1-9e9f-4eda-b2fa-4bafd11f9780 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43912025-01-09T01:36:53.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f6c8d3b1-9e9f-4eda-b2fa-4bafd11f9780 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43922025-01-09T01:36:54.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22d41d4d-1202-4987-bce7-3b9070275105 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43932025-01-09T01:36:54.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22d41d4d-1202-4987-bce7-3b9070275105 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43942025-01-09T01:36:54.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22d41d4d-1202-4987-bce7-3b9070275105 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43952025-01-09T01:36:55.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 212fd090-5e6c-4a01-b389-2f195b0611de roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43962025-01-09T01:36:55.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 212fd090-5e6c-4a01-b389-2f195b0611de resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43972025-01-09T01:36:55.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 212fd090-5e6c-4a01-b389-2f195b0611de response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43982025-01-09T01:36:56.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = de513222-a8b4-40ac-9762-cfc0ba1a259d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
43992025-01-09T01:36:56.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = de513222-a8b4-40ac-9762-cfc0ba1a259d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44002025-01-09T01:36:56.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = de513222-a8b4-40ac-9762-cfc0ba1a259d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44012025-01-09T01:36:56.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
44022025-01-09T01:36:56.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44032025-01-09T01:36:56.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44042025-01-09T01:36:56.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
44052025-01-09T01:36:56.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44062025-01-09T01:36:56.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44072025-01-09T01:36:56.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44082025-01-09T01:36:56.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44092025-01-09T01:36:56.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44102025-01-09T01:36:56.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.389315ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44112025-01-09T01:36:56.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44122025-01-09T01:36:56.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132025-01-09T01:36:56.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44142025-01-09T01:36:56.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44152025-01-09T01:36:56.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44162025-01-09T01:36:56.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44172025-01-09T01:36:56.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
44182025-01-09T01:36:56.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44192025-01-09T01:36:56.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44202025-01-09T01:36:56.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
44212025-01-09T01:36:56.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.49665ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
44222025-01-09T01:36:57.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6491066c-a26e-4740-8da1-f47fab0c20fa roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44232025-01-09T01:36:57.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6491066c-a26e-4740-8da1-f47fab0c20fa resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44242025-01-09T01:36:57.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6491066c-a26e-4740-8da1-f47fab0c20fa response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44252025-01-09T01:36:58.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e6787657-b2a6-4575-a628-bdfb02e83229 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44262025-01-09T01:36:58.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e6787657-b2a6-4575-a628-bdfb02e83229 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44272025-01-09T01:36:58.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e6787657-b2a6-4575-a628-bdfb02e83229 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44282025-01-09T01:36:59.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 20dd497d-55a9-4d6d-8613-f84c54515971 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
44292025-01-09T01:36:59.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 20dd497d-55a9-4d6d-8613-f84c54515971 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
44302025-01-09T01:36:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 20dd497d-55a9-4d6d-8613-f84c54515971 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
44312025-01-09T01:36:59.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = eddb5b98-24d8-4e45-a675-cfcd55b260e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
44322025-01-09T01:36:59.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = eddb5b98-24d8-4e45-a675-cfcd55b260e1 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
44332025-01-09T01:36:59.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 1bb3a1a0-7445-4307-b12f-7efe71054353 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
44342025-01-09T01:36:59.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = eddb5b98-24d8-4e45-a675-cfcd55b260e1 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
44352025-01-09T01:36:59.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e1d652e3-4c6f-44f3-8561-72c06878c58d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44362025-01-09T01:36:59.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e1d652e3-4c6f-44f3-8561-72c06878c58d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44372025-01-09T01:36:59.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e1d652e3-4c6f-44f3-8561-72c06878c58d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44382025-01-09T01:37:00.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 66d989d8-d1cb-43d5-b31e-f2cce1d7bf27 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44392025-01-09T01:37:00.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 66d989d8-d1cb-43d5-b31e-f2cce1d7bf27 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44402025-01-09T01:37:00.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 66d989d8-d1cb-43d5-b31e-f2cce1d7bf27 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44412025-01-09T01:37:01.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7aab65d9-66f7-4dcf-b758-e1ce67b408c7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44422025-01-09T01:37:01.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7aab65d9-66f7-4dcf-b758-e1ce67b408c7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44432025-01-09T01:37:01.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7aab65d9-66f7-4dcf-b758-e1ce67b408c7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44442025-01-09T01:37:02.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 84c3432d-adf6-46b8-a200-d858dcd12100 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44452025-01-09T01:37:02.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 84c3432d-adf6-46b8-a200-d858dcd12100 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44462025-01-09T01:37:02.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 84c3432d-adf6-46b8-a200-d858dcd12100 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44472025-01-09T01:37:03.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 521646cd-d904-4354-8a24-6019a28e58d4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44482025-01-09T01:37:03.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 521646cd-d904-4354-8a24-6019a28e58d4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44492025-01-09T01:37:03.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 521646cd-d904-4354-8a24-6019a28e58d4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44502025-01-09T01:37:04.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea9cbbbc-e033-4039-ab77-d851601a77cd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44512025-01-09T01:37:04.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea9cbbbc-e033-4039-ab77-d851601a77cd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44522025-01-09T01:37:04.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea9cbbbc-e033-4039-ab77-d851601a77cd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44532025-01-09T01:37:05.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90d17a7f-93a8-4ed3-85af-ea4f460d3ca9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44542025-01-09T01:37:05.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90d17a7f-93a8-4ed3-85af-ea4f460d3ca9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44552025-01-09T01:37:05.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90d17a7f-93a8-4ed3-85af-ea4f460d3ca9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44562025-01-09T01:37:06.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ce4c0c1-79f1-4bd3-85ed-5f2da57a00ad roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44572025-01-09T01:37:06.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ce4c0c1-79f1-4bd3-85ed-5f2da57a00ad resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44582025-01-09T01:37:06.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ce4c0c1-79f1-4bd3-85ed-5f2da57a00ad response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44592025-01-09T01:37:06.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
44602025-01-09T01:37:06.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44612025-01-09T01:37:06.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44622025-01-09T01:37:06.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
44632025-01-09T01:37:06.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44642025-01-09T01:37:06.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44652025-01-09T01:37:06.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44662025-01-09T01:37:06.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44672025-01-09T01:37:06.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44682025-01-09T01:37:06.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44692025-01-09T01:37:06.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44702025-01-09T01:37:06.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44712025-01-09T01:37:06.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44722025-01-09T01:37:06.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
44732025-01-09T01:37:06.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44742025-01-09T01:37:06.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44752025-01-09T01:37:06.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
44762025-01-09T01:37:06.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.546729ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
44772025-01-09T01:37:06.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44782025-01-09T01:37:06.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44792025-01-09T01:37:06.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 262.614204ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44802025-01-09T01:37:07.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 938f88d8-79b8-4881-9db3-911a43f647e1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44812025-01-09T01:37:07.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 938f88d8-79b8-4881-9db3-911a43f647e1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44822025-01-09T01:37:07.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 938f88d8-79b8-4881-9db3-911a43f647e1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44832025-01-09T01:37:08.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 859100fe-5893-4da3-b253-643edabea473 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44842025-01-09T01:37:08.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 859100fe-5893-4da3-b253-643edabea473 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44852025-01-09T01:37:08.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 859100fe-5893-4da3-b253-643edabea473 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44862025-01-09T01:37:09.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 967 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = a757f9e8-ad6d-4d41-b6c0-8347efe59e33 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
44872025-01-09T01:37:09.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd41eb5d-c4ad-47f3-a665-5f0c9328007a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44882025-01-09T01:37:09.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd41eb5d-c4ad-47f3-a665-5f0c9328007a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44892025-01-09T01:37:09.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd41eb5d-c4ad-47f3-a665-5f0c9328007a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44902025-01-09T01:37:10.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e40981e9-1e54-456b-bace-e4032a3de3eb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44912025-01-09T01:37:10.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e40981e9-1e54-456b-bace-e4032a3de3eb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44922025-01-09T01:37:10.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e40981e9-1e54-456b-bace-e4032a3de3eb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44932025-01-09T01:37:11.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 94c0d47c-08f0-43eb-9fb6-9a3071014a90 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44942025-01-09T01:37:11.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 94c0d47c-08f0-43eb-9fb6-9a3071014a90 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44952025-01-09T01:37:11.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 94c0d47c-08f0-43eb-9fb6-9a3071014a90 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44962025-01-09T01:37:12.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0d53815-606b-464e-87f6-170334531744 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44972025-01-09T01:37:12.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0d53815-606b-464e-87f6-170334531744 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44982025-01-09T01:37:12.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0d53815-606b-464e-87f6-170334531744 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44992025-01-09T01:37:13.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4ceefcba-1ae5-4777-9f4e-5857144c3a31 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45002025-01-09T01:37:13.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4ceefcba-1ae5-4777-9f4e-5857144c3a31 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45012025-01-09T01:37:13.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4ceefcba-1ae5-4777-9f4e-5857144c3a31 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45022025-01-09T01:37:14.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7d3fe177-de18-448b-887f-39c845e34fd3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45032025-01-09T01:37:14.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7d3fe177-de18-448b-887f-39c845e34fd3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45042025-01-09T01:37:14.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7d3fe177-de18-448b-887f-39c845e34fd3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45052025-01-09T01:37:15.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2557e44a-efe8-4c50-ba7c-46545773210d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45062025-01-09T01:37:15.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2557e44a-efe8-4c50-ba7c-46545773210d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45072025-01-09T01:37:15.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2557e44a-efe8-4c50-ba7c-46545773210d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45082025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
45092025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
45102025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45112025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45122025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
45132025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
45142025-01-09T01:37:16.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45152025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45162025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45172025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45182025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
45192025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
45202025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
45212025-01-09T01:37:16.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45222025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45232025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45242025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
45252025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45262025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
45272025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45282025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
45292025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45302025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
45312025-01-09T01:37:16.603ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45322025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45332025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
45342025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45352025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
45362025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45372025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45382025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45392025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45402025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45412025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45422025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45432025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45442025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45452025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45462025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45472025-01-09T01:37:16.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45482025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
45492025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
45502025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45512025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45522025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45532025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45542025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
45552025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45562025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
45572025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45582025-01-09T01:37:16.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1169, tv_nsec: 8093261 } })
45592025-01-09T01:37:16.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1169, tv_nsec: 8237113 } })
45602025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45612025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45622025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.969314ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45632025-01-09T01:37:16.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642025-01-09T01:37:16.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
45652025-01-09T01:37:16.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
45662025-01-09T01:37:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45672025-01-09T01:37:16.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45682025-01-09T01:37:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45692025-01-09T01:37:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45702025-01-09T01:37:16.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45712025-01-09T01:37:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45722025-01-09T01:37:16.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45732025-01-09T01:37:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45742025-01-09T01:37:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45752025-01-09T01:37:16.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45762025-01-09T01:37:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45772025-01-09T01:37:16.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45782025-01-09T01:37:16.612ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45792025-01-09T01:37:16.612ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45802025-01-09T01:37:16.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45812025-01-09T01:37:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45822025-01-09T01:37:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45832025-01-09T01:37:16.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45842025-01-09T01:37:16.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45852025-01-09T01:37:16.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45862025-01-09T01:37:16.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45872025-01-09T01:37:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45882025-01-09T01:37:16.617ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1169, tv_nsec: 20218836 } })
45892025-01-09T01:37:16.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45902025-01-09T01:37:16.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
45912025-01-09T01:37:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45922025-01-09T01:37:16.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45932025-01-09T01:37:16.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45942025-01-09T01:37:16.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45952025-01-09T01:37:16.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45962025-01-09T01:37:16.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45972025-01-09T01:37:16.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45982025-01-09T01:37:16.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45992025-01-09T01:37:16.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.274984ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46002025-01-09T01:37:16.650ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46012025-01-09T01:37:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46022025-01-09T01:37:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46032025-01-09T01:37:16.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46042025-01-09T01:37:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46052025-01-09T01:37:16.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46062025-01-09T01:37:16.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.125484ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
46072025-01-09T01:37:16.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082025-01-09T01:37:16.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.021681ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46092025-01-09T01:37:16.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46102025-01-09T01:37:16.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46112025-01-09T01:37:16.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46122025-01-09T01:37:16.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46132025-01-09T01:37:16.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46142025-01-09T01:37:16.656ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46152025-01-09T01:37:16.656ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46162025-01-09T01:37:16.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46172025-01-09T01:37:16.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46182025-01-09T01:37:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46192025-01-09T01:37:16.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46202025-01-09T01:37:16.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46212025-01-09T01:37:16.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46222025-01-09T01:37:16.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
46232025-01-09T01:37:16.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46242025-01-09T01:37:16.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46252025-01-09T01:37:16.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-01-09T01:37:16.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.915107ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
46272025-01-09T01:37:16.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
46282025-01-09T01:37:16.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46292025-01-09T01:37:16.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46302025-01-09T01:37:16.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46312025-01-09T01:37:16.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46322025-01-09T01:37:16.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46332025-01-09T01:37:16.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46342025-01-09T01:37:16.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46352025-01-09T01:37:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46362025-01-09T01:37:16.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46372025-01-09T01:37:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46382025-01-09T01:37:16.664ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.105073ms iteration = 8 status = 0
46392025-01-09T01:37:16.695ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
46402025-01-09T01:37:16.695ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.614366ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
46412025-01-09T01:37:16.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ca34046d-901f-4e66-83a8-4c52c5e32601 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
46422025-01-09T01:37:16.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ca34046d-901f-4e66-83a8-4c52c5e32601 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
46432025-01-09T01:37:16.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ca34046d-901f-4e66-83a8-4c52c5e32601 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
46442025-01-09T01:37:16.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46452025-01-09T01:37:16.707ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46462025-01-09T01:37:16.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46472025-01-09T01:37:16.707ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "edfc1675-5e16-4a49-8530-cdec7717911f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
46482025-01-09T01:37:16.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46492025-01-09T01:37:16.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46502025-01-09T01:37:16.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46512025-01-09T01:37:16.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.720163ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46522025-01-09T01:37:16.714ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46532025-01-09T01:37:16.714ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46542025-01-09T01:37:16.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.779658ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46552025-01-09T01:37:16.715ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46562025-01-09T01:37:16.715ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46572025-01-09T01:37:16.715ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f6665bd-27b5-46de-9284-8afd39cca0f6", "content-length": "26", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
46582025-01-09T01:37:16.715ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46592025-01-09T01:37:16.717ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46602025-01-09T01:37:16.723ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
46612025-01-09T01:37:16.723ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46622025-01-09T01:37:16.723ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea3f55f4-f5e8-425c-92d8-0c95a9b49b74", "content-length": "26", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
46632025-01-09T01:37:16.723ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46642025-01-09T01:37:16.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
46652025-01-09T01:37:16.738ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46662025-01-09T01:37:16.738ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 135.341817ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46672025-01-09T01:37:16.792ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.935095ms iteration = 10 status = {"physical_disks_added":0}
46682025-01-09T01:37:16.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46692025-01-09T01:37:16.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46702025-01-09T01:37:16.842ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46712025-01-09T01:37:16.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46722025-01-09T01:37:16.842ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b807d10-8e57-44c0-a944-731ea425a15c", "content-length": "372", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
46732025-01-09T01:37:16.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46742025-01-09T01:37:16.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46752025-01-09T01:37:16.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46762025-01-09T01:37:16.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46772025-01-09T01:37:16.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46782025-01-09T01:37:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46792025-01-09T01:37:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.583555ms iteration = 8 status = {}
46802025-01-09T01:37:16.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 267.455542ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46812025-01-09T01:37:16.876ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46822025-01-09T01:37:16.877ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "130f254a-22e5-4d04-9c18-32b6fad59a65", "content-length": "1", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
46832025-01-09T01:37:16.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46842025-01-09T01:37:16.879ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46852025-01-09T01:37:16.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46862025-01-09T01:37:16.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46872025-01-09T01:37:16.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46882025-01-09T01:37:16.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46892025-01-09T01:37:16.881ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 279.520077ms iteration = 8 status = null
46902025-01-09T01:37:16.890ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46912025-01-09T01:37:16.890ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46922025-01-09T01:37:16.890ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6041fa14-3336-4033-8838-4234fae5e3f9", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
46932025-01-09T01:37:16.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46942025-01-09T01:37:16.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46952025-01-09T01:37:16.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46962025-01-09T01:37:16.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46972025-01-09T01:37:16.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46982025-01-09T01:37:16.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46992025-01-09T01:37:16.900ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47002025-01-09T01:37:16.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47012025-01-09T01:37:16.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c390cb2-9427-4069-b110-da30a3111a61", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
47022025-01-09T01:37:16.902ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 299.489097ms iteration = 8 status = {}
47032025-01-09T01:37:16.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47042025-01-09T01:37:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47052025-01-09T01:37:16.960ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
47062025-01-09T01:37:16.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47072025-01-09T01:37:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47082025-01-09T01:37:16.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47092025-01-09T01:37:16.994ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf983cd4-543c-4eac-b0ff-8a7735cec6ca", "content-length": "691", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
47102025-01-09T01:37:16.994ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47112025-01-09T01:37:16.994ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47122025-01-09T01:37:16.994ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47132025-01-09T01:37:16.995ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.771528ms iteration = 8 status = {}
47142025-01-09T01:37:17.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47152025-01-09T01:37:17.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f3c3510-b3cf-4ed1-87b0-69063a8961dd", "content-length": "134", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
47162025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47172025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
47182025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47192025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47202025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47212025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47222025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47232025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47242025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47252025-01-09T01:37:17.101ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47262025-01-09T01:37:17.102ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
47272025-01-09T01:37:17.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47282025-01-09T01:37:17.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47292025-01-09T01:37:17.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47302025-01-09T01:37:17.104ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bd21141-035a-4b34-950f-9d73769313bd", "content-length": "2", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
47312025-01-09T01:37:17.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47322025-01-09T01:37:17.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d153c86-8ffe-4530-9b96-0b7bfa189433", "content-length": "52", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
47332025-01-09T01:37:17.105ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
47342025-01-09T01:37:17.105ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47352025-01-09T01:37:17.160ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
47362025-01-09T01:37:17.160ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
47372025-01-09T01:37:17.191ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
47382025-01-09T01:37:17.191ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:36170
47392025-01-09T01:37:17.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36170 req_id = 4635b65e-9b44-466b-bfd5-7af9deb540fe roles = RoleSet { roles: {} } uri = /metrics/producers
47402025-01-09T01:37:17.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36170 req_id = 4635b65e-9b44-466b-bfd5-7af9deb540fe resource = Database result = Ok(()) uri = /metrics/producers
47412025-01-09T01:37:17.230ZINFOnexus: assigned collector to new producer collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:76 producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
47422025-01-09T01:37:17.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39200 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36170 req_id = 4635b65e-9b44-466b-bfd5-7af9deb540fe response_code = 201 uri = /metrics/producers
47432025-01-09T01:37:17.230ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4635b65e-9b44-466b-bfd5-7af9deb540fe", "content-length": "41", "date": "Thu, 09 Jan 2025 01:37:17 GMT"} })
47442025-01-09T01:37:17.231ZDEBGnexus (producer-registration-task): registered with nexus successfully
47452025-01-09T01:37:17.231ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47462025-01-09T01:37:17.240ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bf459302-0a95-467d-bd8e-17d55dc757b4", "date": "Thu, 09 Jan 2025 01:37:17 GMT"} })
47472025-01-09T01:37:17.241ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
47482025-01-09T01:37:17.241ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47492025-01-09T01:37:17.245ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "510eab23-b1f1-4fbe-bf33-a00ba5352da6", "content-length": "682", "date": "Thu, 09 Jan 2025 01:37:16 GMT"} })
47502025-01-09T01:37:17.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47512025-01-09T01:37:17.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47522025-01-09T01:37:17.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47532025-01-09T01:37:17.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47542025-01-09T01:37:17.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47552025-01-09T01:37:17.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47562025-01-09T01:37:17.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47572025-01-09T01:37:17.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47582025-01-09T01:37:17.269ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 666.239797ms iteration = 8 status = {}
47592025-01-09T01:37:17.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2773cfca-943e-4b12-9e63-50bfda9ea2b7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47602025-01-09T01:37:17.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2773cfca-943e-4b12-9e63-50bfda9ea2b7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47612025-01-09T01:37:17.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2773cfca-943e-4b12-9e63-50bfda9ea2b7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47622025-01-09T01:37:17.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 0df48d37-4bb8-40ea-8a74-3dcad71a4bb5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
47632025-01-09T01:37:17.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 0df48d37-4bb8-40ea-8a74-3dcad71a4bb5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
47642025-01-09T01:37:17.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 0df48d37-4bb8-40ea-8a74-3dcad71a4bb5 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
47652025-01-09T01:37:18.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d2a6b26-6fbf-4796-8dff-7afb2d89e08a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47662025-01-09T01:37:18.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d2a6b26-6fbf-4796-8dff-7afb2d89e08a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47672025-01-09T01:37:18.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d2a6b26-6fbf-4796-8dff-7afb2d89e08a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47682025-01-09T01:37:19.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 57195410-402d-49ca-aacd-307bf93eab26 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
47692025-01-09T01:37:19.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90972f1d-8738-4517-b8db-4248b5fba488 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47702025-01-09T01:37:19.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90972f1d-8738-4517-b8db-4248b5fba488 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47712025-01-09T01:37:19.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90972f1d-8738-4517-b8db-4248b5fba488 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47722025-01-09T01:37:20.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b7561bb-5d1c-4a3b-a713-2a3e80b64611 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47732025-01-09T01:37:20.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b7561bb-5d1c-4a3b-a713-2a3e80b64611 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47742025-01-09T01:37:20.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b7561bb-5d1c-4a3b-a713-2a3e80b64611 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47752025-01-09T01:37:21.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea4e4c7b-054c-41c1-b2b1-fdb59e7c11da roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47762025-01-09T01:37:21.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea4e4c7b-054c-41c1-b2b1-fdb59e7c11da resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47772025-01-09T01:37:21.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea4e4c7b-054c-41c1-b2b1-fdb59e7c11da response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47782025-01-09T01:37:22.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82888937-fd82-455e-8f2b-de49b39bb2d2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47792025-01-09T01:37:22.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82888937-fd82-455e-8f2b-de49b39bb2d2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47802025-01-09T01:37:22.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82888937-fd82-455e-8f2b-de49b39bb2d2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47812025-01-09T01:37:23.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ac73575c-95ac-4cfc-a276-ba06f0f375d7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47822025-01-09T01:37:23.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ac73575c-95ac-4cfc-a276-ba06f0f375d7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47832025-01-09T01:37:23.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ac73575c-95ac-4cfc-a276-ba06f0f375d7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47842025-01-09T01:37:24.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d74fb443-6e38-421e-b976-4759675e1696 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47852025-01-09T01:37:24.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d74fb443-6e38-421e-b976-4759675e1696 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47862025-01-09T01:37:24.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d74fb443-6e38-421e-b976-4759675e1696 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47872025-01-09T01:37:25.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae3a0b56-935d-4849-9903-265f2510fb3d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47882025-01-09T01:37:25.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae3a0b56-935d-4849-9903-265f2510fb3d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47892025-01-09T01:37:25.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae3a0b56-935d-4849-9903-265f2510fb3d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
47902025-01-09T01:37:26.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
47912025-01-09T01:37:26.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47922025-01-09T01:37:26.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47932025-01-09T01:37:26.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
47942025-01-09T01:37:26.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47952025-01-09T01:37:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47962025-01-09T01:37:26.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47972025-01-09T01:37:26.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47982025-01-09T01:37:26.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47992025-01-09T01:37:26.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48002025-01-09T01:37:26.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48012025-01-09T01:37:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48022025-01-09T01:37:26.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48032025-01-09T01:37:26.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
48042025-01-09T01:37:26.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48052025-01-09T01:37:26.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48062025-01-09T01:37:26.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
48072025-01-09T01:37:26.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.543788ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
48082025-01-09T01:37:26.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48092025-01-09T01:37:26.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48102025-01-09T01:37:26.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.563742ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48112025-01-09T01:37:26.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79594f7a-2099-413e-a68a-8942c63a3271 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48122025-01-09T01:37:26.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79594f7a-2099-413e-a68a-8942c63a3271 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48132025-01-09T01:37:26.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79594f7a-2099-413e-a68a-8942c63a3271 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48142025-01-09T01:37:27.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0b5b4e08-bc2d-4917-9a66-72a6daf68047 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48152025-01-09T01:37:27.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0b5b4e08-bc2d-4917-9a66-72a6daf68047 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48162025-01-09T01:37:27.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0b5b4e08-bc2d-4917-9a66-72a6daf68047 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48172025-01-09T01:37:28.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9868e19d-6691-41d7-a19c-789a4560436b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48182025-01-09T01:37:28.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9868e19d-6691-41d7-a19c-789a4560436b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48192025-01-09T01:37:28.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9868e19d-6691-41d7-a19c-789a4560436b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48202025-01-09T01:37:29.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 617 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = d267d671-650d-4a1f-8c62-9a62dac238a9 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
48212025-01-09T01:37:29.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 46947d8f-0d25-490f-8ba4-5b68ed349fea roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48222025-01-09T01:37:29.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 46947d8f-0d25-490f-8ba4-5b68ed349fea resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48232025-01-09T01:37:29.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 46947d8f-0d25-490f-8ba4-5b68ed349fea response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48242025-01-09T01:37:31.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 671ab788-dc09-4003-9f8b-fc9457111ce3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48252025-01-09T01:37:31.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 671ab788-dc09-4003-9f8b-fc9457111ce3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48262025-01-09T01:37:31.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 671ab788-dc09-4003-9f8b-fc9457111ce3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48272025-01-09T01:37:32.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ecedc90-23d8-40f8-a02f-285ea73d5f29 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48282025-01-09T01:37:32.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ecedc90-23d8-40f8-a02f-285ea73d5f29 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48292025-01-09T01:37:32.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ecedc90-23d8-40f8-a02f-285ea73d5f29 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48302025-01-09T01:37:33.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c9f106c-3ddd-480b-a743-b8075109c18b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48312025-01-09T01:37:33.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c9f106c-3ddd-480b-a743-b8075109c18b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48322025-01-09T01:37:33.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c9f106c-3ddd-480b-a743-b8075109c18b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48332025-01-09T01:37:34.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4b8a419e-11bc-4eb6-8cd7-41a723c68f73 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48342025-01-09T01:37:34.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4b8a419e-11bc-4eb6-8cd7-41a723c68f73 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48352025-01-09T01:37:34.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4b8a419e-11bc-4eb6-8cd7-41a723c68f73 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48362025-01-09T01:37:35.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3b9fbad-2b32-4d7e-95b3-2d0435afa0af roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48372025-01-09T01:37:35.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3b9fbad-2b32-4d7e-95b3-2d0435afa0af resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48382025-01-09T01:37:35.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3b9fbad-2b32-4d7e-95b3-2d0435afa0af response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48392025-01-09T01:37:36.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3121f6bd-f75c-4e18-8f00-6b9a123ee139 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48402025-01-09T01:37:36.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3121f6bd-f75c-4e18-8f00-6b9a123ee139 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48412025-01-09T01:37:36.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3121f6bd-f75c-4e18-8f00-6b9a123ee139 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48422025-01-09T01:37:36.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
48432025-01-09T01:37:36.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48442025-01-09T01:37:36.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48452025-01-09T01:37:36.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
48462025-01-09T01:37:36.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48472025-01-09T01:37:36.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48482025-01-09T01:37:36.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48492025-01-09T01:37:36.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48502025-01-09T01:37:36.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48512025-01-09T01:37:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48522025-01-09T01:37:36.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48532025-01-09T01:37:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48542025-01-09T01:37:36.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.547168ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48552025-01-09T01:37:36.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48562025-01-09T01:37:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48572025-01-09T01:37:36.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48582025-01-09T01:37:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
48592025-01-09T01:37:36.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48602025-01-09T01:37:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48612025-01-09T01:37:36.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
48622025-01-09T01:37:36.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.462045ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
48632025-01-09T01:37:37.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a9310d6-579d-4195-b4fb-6cfaca8d6001 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48642025-01-09T01:37:37.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a9310d6-579d-4195-b4fb-6cfaca8d6001 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48652025-01-09T01:37:37.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a9310d6-579d-4195-b4fb-6cfaca8d6001 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48662025-01-09T01:37:38.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73ffeaa7-d13e-420d-9263-806ee5575e0e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48672025-01-09T01:37:38.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73ffeaa7-d13e-420d-9263-806ee5575e0e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48682025-01-09T01:37:38.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73ffeaa7-d13e-420d-9263-806ee5575e0e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48692025-01-09T01:37:39.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58b5abf9-8b4a-40a9-93b8-96f291c32dfc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48702025-01-09T01:37:39.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58b5abf9-8b4a-40a9-93b8-96f291c32dfc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48712025-01-09T01:37:39.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58b5abf9-8b4a-40a9-93b8-96f291c32dfc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48722025-01-09T01:37:39.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1017 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = f529507b-af9d-4002-b8b8-4eeb46bede84 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
48732025-01-09T01:37:40.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 688be3d8-f7e4-4006-ba5b-30b144a4787a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48742025-01-09T01:37:40.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 688be3d8-f7e4-4006-ba5b-30b144a4787a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48752025-01-09T01:37:40.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 688be3d8-f7e4-4006-ba5b-30b144a4787a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48762025-01-09T01:37:41.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a942dc78-b8a2-4299-9245-c37103bbeeee roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48772025-01-09T01:37:41.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a942dc78-b8a2-4299-9245-c37103bbeeee resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48782025-01-09T01:37:41.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a942dc78-b8a2-4299-9245-c37103bbeeee response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48792025-01-09T01:37:42.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 23e8b6a5-efc1-448b-88ae-9077c99bccb2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48802025-01-09T01:37:42.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 23e8b6a5-efc1-448b-88ae-9077c99bccb2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48812025-01-09T01:37:42.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 23e8b6a5-efc1-448b-88ae-9077c99bccb2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48822025-01-09T01:37:43.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b87f4838-2f89-44d9-948a-e4945620a05d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48832025-01-09T01:37:43.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b87f4838-2f89-44d9-948a-e4945620a05d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48842025-01-09T01:37:43.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b87f4838-2f89-44d9-948a-e4945620a05d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48852025-01-09T01:37:44.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1b9b5535-e762-4af2-8f91-ab1ee71bd6c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
48862025-01-09T01:37:44.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1b9b5535-e762-4af2-8f91-ab1ee71bd6c6 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
48872025-01-09T01:37:44.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73b6f142-d476-4ac9-9c21-f11337bd5cc9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48882025-01-09T01:37:44.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73b6f142-d476-4ac9-9c21-f11337bd5cc9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48892025-01-09T01:37:44.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73b6f142-d476-4ac9-9c21-f11337bd5cc9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48902025-01-09T01:37:44.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1b9b5535-e762-4af2-8f91-ab1ee71bd6c6 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
48912025-01-09T01:37:44.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 13489a03-a55e-4d59-a202-d4f3dc7f59cf roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
48922025-01-09T01:37:44.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 13489a03-a55e-4d59-a202-d4f3dc7f59cf resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
48932025-01-09T01:37:44.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 13489a03-a55e-4d59-a202-d4f3dc7f59cf response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
48942025-01-09T01:37:45.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ef5ad72c-02fb-44ae-91d1-ef0c614eb354 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48952025-01-09T01:37:45.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ef5ad72c-02fb-44ae-91d1-ef0c614eb354 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48962025-01-09T01:37:45.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ef5ad72c-02fb-44ae-91d1-ef0c614eb354 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48972025-01-09T01:37:46.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db84f756-129f-465b-bb77-7e1e5ac69e09 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48982025-01-09T01:37:46.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db84f756-129f-465b-bb77-7e1e5ac69e09 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
48992025-01-09T01:37:46.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db84f756-129f-465b-bb77-7e1e5ac69e09 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
49002025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
49012025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
49022025-01-09T01:37:46.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
49032025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
49042025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.4\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
49052025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49062025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
49072025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
49082025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49092025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
49102025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49112025-01-09T01:37:46.601ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:27:46.601900366 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49122025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49132025-01-09T01:37:46.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
49142025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
49152025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
49162025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49172025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49182025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49192025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
49202025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
49212025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49222025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
49232025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
49242025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49252025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49262025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49272025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49282025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49292025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49302025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49312025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49322025-01-09T01:37:46.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 4725237 } })
49332025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
49342025-01-09T01:37:46.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 4929770 } })
49352025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49362025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
49372025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
49382025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49392025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49402025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
49412025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49422025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
49432025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49442025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
49452025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49462025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
49472025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49482025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
49492025-01-09T01:37:46.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49502025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
49512025-01-09T01:37:46.603ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49522025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49532025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
49542025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49552025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49562025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
49572025-01-09T01:37:46.603ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49582025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49592025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49602025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
49612025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49622025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.126158ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
49632025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49642025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49652025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49662025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49672025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49682025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49692025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49702025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49712025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49722025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
49732025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.413753ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
49742025-01-09T01:37:46.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49752025-01-09T01:37:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49762025-01-09T01:37:46.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49772025-01-09T01:37:46.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49782025-01-09T01:37:46.604ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:27:46.601900366 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49792025-01-09T01:37:46.604ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.976528ms iteration = 5 status = {"expiration":"2025-01-09T01:27:46.601900366Z","pruned":[]}
49802025-01-09T01:37:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49812025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.507786ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49832025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
49842025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49852025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
49862025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
49872025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49882025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49892025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
49902025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49912025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49922025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49932025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49942025-01-09T01:37:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49952025-01-09T01:37:46.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
49962025-01-09T01:37:46.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49972025-01-09T01:37:46.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
49982025-01-09T01:37:46.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49992025-01-09T01:37:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50002025-01-09T01:37:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50012025-01-09T01:37:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50022025-01-09T01:37:46.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50032025-01-09T01:37:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50042025-01-09T01:37:46.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50052025-01-09T01:37:46.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50062025-01-09T01:37:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50072025-01-09T01:37:46.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 11713799 } })
50082025-01-09T01:37:46.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
50092025-01-09T01:37:46.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 12172917 } })
50102025-01-09T01:37:46.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112025-01-09T01:37:46.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50122025-01-09T01:37:46.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132025-01-09T01:37:46.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142025-01-09T01:37:46.612ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50152025-01-09T01:37:46.612ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50162025-01-09T01:37:46.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50172025-01-09T01:37:46.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50182025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50192025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50202025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50212025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50222025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50232025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50242025-01-09T01:37:46.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50252025-01-09T01:37:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50262025-01-09T01:37:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50272025-01-09T01:37:46.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50282025-01-09T01:37:46.616ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50292025-01-09T01:37:46.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50302025-01-09T01:37:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50312025-01-09T01:37:46.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50322025-01-09T01:37:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50332025-01-09T01:37:46.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50342025-01-09T01:37:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50352025-01-09T01:37:46.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50362025-01-09T01:37:46.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50372025-01-09T01:37:46.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50382025-01-09T01:37:46.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50392025-01-09T01:37:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50402025-01-09T01:37:46.622ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.750839ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
50412025-01-09T01:37:46.622ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50422025-01-09T01:37:46.622ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50432025-01-09T01:37:46.622ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.261448ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50442025-01-09T01:37:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50452025-01-09T01:37:46.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.135018ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
50462025-01-09T01:37:46.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50472025-01-09T01:37:46.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50482025-01-09T01:37:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50492025-01-09T01:37:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50502025-01-09T01:37:46.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50512025-01-09T01:37:46.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50522025-01-09T01:37:46.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1199, tv_nsec: 31426656 } })
50532025-01-09T01:37:46.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50542025-01-09T01:37:46.629ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
50552025-01-09T01:37:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50562025-01-09T01:37:46.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50572025-01-09T01:37:46.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50582025-01-09T01:37:46.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50592025-01-09T01:37:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50602025-01-09T01:37:46.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612025-01-09T01:37:46.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50622025-01-09T01:37:46.649ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50632025-01-09T01:37:46.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50642025-01-09T01:37:46.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.43204ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
50652025-01-09T01:37:46.663ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50662025-01-09T01:37:46.663ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50672025-01-09T01:37:46.663ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50682025-01-09T01:37:46.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50692025-01-09T01:37:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50702025-01-09T01:37:46.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50712025-01-09T01:37:46.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50722025-01-09T01:37:46.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.699505ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50732025-01-09T01:37:46.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50742025-01-09T01:37:46.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50752025-01-09T01:37:46.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50762025-01-09T01:37:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50772025-01-09T01:37:46.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50782025-01-09T01:37:46.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50792025-01-09T01:37:46.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50802025-01-09T01:37:46.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50812025-01-09T01:37:46.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50822025-01-09T01:37:46.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50832025-01-09T01:37:46.676ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50842025-01-09T01:37:46.676ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50852025-01-09T01:37:46.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50862025-01-09T01:37:46.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50872025-01-09T01:37:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50882025-01-09T01:37:46.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50892025-01-09T01:37:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50902025-01-09T01:37:46.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50912025-01-09T01:37:46.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.253546ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50922025-01-09T01:37:46.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50932025-01-09T01:37:46.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50942025-01-09T01:37:46.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50952025-01-09T01:37:46.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50962025-01-09T01:37:46.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50972025-01-09T01:37:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
50982025-01-09T01:37:46.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50992025-01-09T01:37:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51002025-01-09T01:37:46.699ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51012025-01-09T01:37:46.699ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.221898ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51022025-01-09T01:37:46.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51032025-01-09T01:37:46.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51042025-01-09T01:37:46.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51052025-01-09T01:37:46.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
51062025-01-09T01:37:46.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.476636ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
51072025-01-09T01:37:46.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51082025-01-09T01:37:46.721ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51092025-01-09T01:37:46.721ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51102025-01-09T01:37:46.721ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.71467ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51112025-01-09T01:37:46.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51122025-01-09T01:37:46.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51132025-01-09T01:37:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51142025-01-09T01:37:46.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51152025-01-09T01:37:46.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51162025-01-09T01:37:46.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.813307ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51172025-01-09T01:37:46.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51182025-01-09T01:37:46.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51192025-01-09T01:37:46.753ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51202025-01-09T01:37:46.753ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
51212025-01-09T01:37:46.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51222025-01-09T01:37:46.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51232025-01-09T01:37:46.754ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51242025-01-09T01:37:46.754ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51252025-01-09T01:37:46.754ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.405315ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51262025-01-09T01:37:46.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51272025-01-09T01:37:46.757ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51282025-01-09T01:37:46.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51292025-01-09T01:37:46.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51302025-01-09T01:37:46.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51312025-01-09T01:37:46.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51322025-01-09T01:37:46.761ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51332025-01-09T01:37:46.761ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
51342025-01-09T01:37:46.761ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51352025-01-09T01:37:46.761ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
51362025-01-09T01:37:46.761ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.020384ms iteration = 5 status = {"generation":2}
51372025-01-09T01:37:46.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51382025-01-09T01:37:46.763ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51392025-01-09T01:37:46.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51402025-01-09T01:37:46.765ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51412025-01-09T01:37:46.765ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51422025-01-09T01:37:46.765ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf655717-7d99-406a-ad93-c2f1e8e2426f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
51432025-01-09T01:37:46.765ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51442025-01-09T01:37:46.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51452025-01-09T01:37:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.46561ms iteration = 11 status = {"physical_disks_added":0}
51462025-01-09T01:37:46.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51472025-01-09T01:37:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51482025-01-09T01:37:46.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 171.748003ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
51492025-01-09T01:37:46.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51502025-01-09T01:37:46.782ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51512025-01-09T01:37:46.782ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51522025-01-09T01:37:46.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51532025-01-09T01:37:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51542025-01-09T01:37:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51552025-01-09T01:37:46.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51562025-01-09T01:37:46.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51572025-01-09T01:37:46.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51582025-01-09T01:37:46.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51592025-01-09T01:37:46.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51602025-01-09T01:37:46.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51612025-01-09T01:37:46.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51622025-01-09T01:37:46.789ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51632025-01-09T01:37:46.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
51642025-01-09T01:37:46.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51652025-01-09T01:37:46.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51662025-01-09T01:37:46.822ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
51672025-01-09T01:37:46.822ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 220.830192ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51682025-01-09T01:37:46.855ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51692025-01-09T01:37:46.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 253.086451ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51702025-01-09T01:37:46.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51712025-01-09T01:37:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51722025-01-09T01:37:46.930ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51732025-01-09T01:37:46.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51742025-01-09T01:37:46.930ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5c347b0-c02d-4c38-9bf9-f900c3303105", "content-length": "372", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
51752025-01-09T01:37:46.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51762025-01-09T01:37:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51772025-01-09T01:37:46.938ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 335.414516ms iteration = 9 status = 0
51782025-01-09T01:37:46.942ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51792025-01-09T01:37:46.942ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51802025-01-09T01:37:46.942ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
51812025-01-09T01:37:46.942ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 341.006625ms iteration = 5 status = {"generation":1}
51822025-01-09T01:37:46.943ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51832025-01-09T01:37:46.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51842025-01-09T01:37:46.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51852025-01-09T01:37:46.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51862025-01-09T01:37:46.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51872025-01-09T01:37:46.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51882025-01-09T01:37:46.953ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51892025-01-09T01:37:46.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51902025-01-09T01:37:46.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51912025-01-09T01:37:46.956ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51922025-01-09T01:37:46.957ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a2c3e8e-d51a-4471-885d-af7c13b0eac3", "content-length": "1", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
51932025-01-09T01:37:46.958ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51942025-01-09T01:37:46.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51952025-01-09T01:37:46.961ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 359.904179ms iteration = 9 status = null
51962025-01-09T01:37:47.003ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
51972025-01-09T01:37:47.003ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51982025-01-09T01:37:47.003ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02d91e8-8a27-47fb-8f88-ddd0f3fde97c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
51992025-01-09T01:37:47.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52002025-01-09T01:37:47.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
52012025-01-09T01:37:47.006ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52022025-01-09T01:37:47.007ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "aae4e9e0-cbb4-4c58-898d-d329067d3666", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52032025-01-09T01:37:47.007ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52042025-01-09T01:37:47.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f6064f0a-a28b-4884-a32c-577373540078", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52052025-01-09T01:37:47.009ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52062025-01-09T01:37:47.009ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52072025-01-09T01:37:47.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52082025-01-09T01:37:47.010ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c3427cdd-3b4a-4dfe-b518-edb2ff2aea36", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
52092025-01-09T01:37:47.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52102025-01-09T01:37:47.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52112025-01-09T01:37:47.011ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52122025-01-09T01:37:47.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 409.553459ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52132025-01-09T01:37:47.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52142025-01-09T01:37:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52152025-01-09T01:37:47.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52162025-01-09T01:37:47.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52172025-01-09T01:37:47.021ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52182025-01-09T01:37:47.021ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52192025-01-09T01:37:47.021ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "908e8e30-bb44-4efc-9a22-bb508fd582d3", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
52202025-01-09T01:37:47.022ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 420.037806ms iteration = 9 status = {}
52212025-01-09T01:37:47.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52222025-01-09T01:37:47.078ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52232025-01-09T01:37:47.079ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74174e8e-4301-4768-88c1-6ed22629bb06", "content-length": "26", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
52242025-01-09T01:37:47.079ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52252025-01-09T01:37:47.081ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52262025-01-09T01:37:47.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52272025-01-09T01:37:47.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ca96058-5de6-428f-9dbc-9ed22564ef3a", "content-length": "691", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
52282025-01-09T01:37:47.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52292025-01-09T01:37:47.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52302025-01-09T01:37:47.095ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52312025-01-09T01:37:47.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.941716ms iteration = 9 status = {}
52322025-01-09T01:37:47.129ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
52332025-01-09T01:37:47.229ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52342025-01-09T01:37:47.230ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d0d211f7-5b2c-4b37-9d62-c4696e840dbf", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52352025-01-09T01:37:47.230ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52362025-01-09T01:37:47.231ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "df9c5fe5-46e6-4027-9da9-0b81207752c2", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52372025-01-09T01:37:47.231ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52382025-01-09T01:37:47.232ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b939c965-4b15-4f9b-9936-0bb5e7cb1ac0", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52392025-01-09T01:37:47.232ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52402025-01-09T01:37:47.234ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
52412025-01-09T01:37:47.234ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 632.612866ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52422025-01-09T01:37:47.301ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 699.97719ms iteration = 9 status = {}
52432025-01-09T01:37:47.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52442025-01-09T01:37:47.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52452025-01-09T01:37:47.337ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
52462025-01-09T01:37:47.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52472025-01-09T01:37:47.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52482025-01-09T01:37:47.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30b5a262-daa9-48ca-a84c-f36aaf4dcec1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52492025-01-09T01:37:47.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30b5a262-daa9-48ca-a84c-f36aaf4dcec1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52502025-01-09T01:37:47.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30b5a262-daa9-48ca-a84c-f36aaf4dcec1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52512025-01-09T01:37:47.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52522025-01-09T01:37:47.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffb90bda-1d56-41b3-987f-00fb28c78b85", "content-length": "134", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} })
52532025-01-09T01:37:47.438ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52542025-01-09T01:37:47.438ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
52552025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52562025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52572025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52582025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52592025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52602025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52612025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52622025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52632025-01-09T01:37:47.439ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
52642025-01-09T01:37:47.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52652025-01-09T01:37:47.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52662025-01-09T01:37:47.441ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52672025-01-09T01:37:47.441ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d1f56ec-c397-4071-8ace-7394455b632c", "content-length": "2", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} })
52682025-01-09T01:37:47.441ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52692025-01-09T01:37:47.441ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5a2f51a-a6f9-4b45-8a7c-a5cbc9cd86fc", "content-length": "52", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} })
52702025-01-09T01:37:47.442ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
52712025-01-09T01:37:47.442ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52722025-01-09T01:37:47.539ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a3c3b569-20ac-4f7c-8347-a7dbc6e4da7e", "date": "Thu, 09 Jan 2025 01:37:46 GMT"} })
52732025-01-09T01:37:47.539ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
52742025-01-09T01:37:47.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52752025-01-09T01:37:47.539ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8d87903-57bf-4562-9c68-55df9bcf0feb", "content-length": "682", "date": "Thu, 09 Jan 2025 01:37:47 GMT"} })
52762025-01-09T01:37:47.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52772025-01-09T01:37:47.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52782025-01-09T01:37:47.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52792025-01-09T01:37:47.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52802025-01-09T01:37:47.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52812025-01-09T01:37:47.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52822025-01-09T01:37:47.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52832025-01-09T01:37:47.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52842025-01-09T01:37:47.672ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.069702638s iteration = 9 status = {}
52852025-01-09T01:37:47.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 22d83294-19a7-4d48-9f76-0cd08fbf172e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
52862025-01-09T01:37:47.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 22d83294-19a7-4d48-9f76-0cd08fbf172e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
52872025-01-09T01:37:47.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 22d83294-19a7-4d48-9f76-0cd08fbf172e response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
52882025-01-09T01:37:48.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f4882cd-ae67-41e5-bd19-1b62d966fd9a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52892025-01-09T01:37:48.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f4882cd-ae67-41e5-bd19-1b62d966fd9a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52902025-01-09T01:37:48.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f4882cd-ae67-41e5-bd19-1b62d966fd9a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52912025-01-09T01:37:49.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 8fae294d-9df4-4be9-bfe8-5da6d8a62b58 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
52922025-01-09T01:37:49.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4515c195-94be-42d1-9677-1c9d46492ee9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52932025-01-09T01:37:49.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4515c195-94be-42d1-9677-1c9d46492ee9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52942025-01-09T01:37:49.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4515c195-94be-42d1-9677-1c9d46492ee9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52952025-01-09T01:37:50.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fbaa6eca-157d-4085-bbfd-fbd27fdd59ca roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52962025-01-09T01:37:50.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fbaa6eca-157d-4085-bbfd-fbd27fdd59ca resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52972025-01-09T01:37:50.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fbaa6eca-157d-4085-bbfd-fbd27fdd59ca response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52982025-01-09T01:37:51.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = faf85e34-59ae-4879-a924-7220f52ee708 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
52992025-01-09T01:37:51.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = faf85e34-59ae-4879-a924-7220f52ee708 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53002025-01-09T01:37:51.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = faf85e34-59ae-4879-a924-7220f52ee708 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53012025-01-09T01:37:52.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 03e144a7-369c-408f-8b3a-e9d8d77bc107 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53022025-01-09T01:37:52.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 03e144a7-369c-408f-8b3a-e9d8d77bc107 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53032025-01-09T01:37:52.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 03e144a7-369c-408f-8b3a-e9d8d77bc107 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53042025-01-09T01:37:53.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e0b7d2ae-a01a-484c-a51d-9633e5673b80 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53052025-01-09T01:37:53.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e0b7d2ae-a01a-484c-a51d-9633e5673b80 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53062025-01-09T01:37:53.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e0b7d2ae-a01a-484c-a51d-9633e5673b80 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53072025-01-09T01:37:54.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5543a9c4-1043-4af7-9c92-e8ba9a411a88 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53082025-01-09T01:37:54.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5543a9c4-1043-4af7-9c92-e8ba9a411a88 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53092025-01-09T01:37:54.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5543a9c4-1043-4af7-9c92-e8ba9a411a88 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53102025-01-09T01:37:55.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82b60744-a41b-4196-a9f4-da3488f66ad3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53112025-01-09T01:37:55.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82b60744-a41b-4196-a9f4-da3488f66ad3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53122025-01-09T01:37:55.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82b60744-a41b-4196-a9f4-da3488f66ad3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53132025-01-09T01:37:56.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 93ead9ff-c698-4d12-9eec-8c1be4fdb218 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53142025-01-09T01:37:56.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 93ead9ff-c698-4d12-9eec-8c1be4fdb218 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53152025-01-09T01:37:56.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 93ead9ff-c698-4d12-9eec-8c1be4fdb218 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53162025-01-09T01:37:56.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
53172025-01-09T01:37:56.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53182025-01-09T01:37:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53192025-01-09T01:37:56.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
53202025-01-09T01:37:56.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53212025-01-09T01:37:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53222025-01-09T01:37:56.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53232025-01-09T01:37:56.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53242025-01-09T01:37:56.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252025-01-09T01:37:56.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53262025-01-09T01:37:56.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53272025-01-09T01:37:56.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53282025-01-09T01:37:56.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53292025-01-09T01:37:56.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53302025-01-09T01:37:56.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312025-01-09T01:37:56.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
53322025-01-09T01:37:56.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53332025-01-09T01:37:56.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53342025-01-09T01:37:56.659ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
53352025-01-09T01:37:56.659ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.748603ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
53362025-01-09T01:37:56.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.18279ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53372025-01-09T01:37:57.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6024b9dd-54aa-4304-a5d2-06756ae32b20 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53382025-01-09T01:37:57.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6024b9dd-54aa-4304-a5d2-06756ae32b20 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53392025-01-09T01:37:57.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6024b9dd-54aa-4304-a5d2-06756ae32b20 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53402025-01-09T01:37:58.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aaa94262-cfe0-426e-b139-a64cf901ebfd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53412025-01-09T01:37:58.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aaa94262-cfe0-426e-b139-a64cf901ebfd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53422025-01-09T01:37:58.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aaa94262-cfe0-426e-b139-a64cf901ebfd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53432025-01-09T01:37:59.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 3c31366a-9fe0-4f6a-bab4-ba3ef0806a64 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
53442025-01-09T01:37:59.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 3c31366a-9fe0-4f6a-bab4-ba3ef0806a64 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
53452025-01-09T01:37:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 3c31366a-9fe0-4f6a-bab4-ba3ef0806a64 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
53462025-01-09T01:37:59.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 47299f8a-523d-49d6-ba11-97746d212cd2 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
53472025-01-09T01:37:59.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 47299f8a-523d-49d6-ba11-97746d212cd2 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
53482025-01-09T01:37:59.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 47299f8a-523d-49d6-ba11-97746d212cd2 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
53492025-01-09T01:37:59.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 380f312e-57d0-4ff0-995f-b3ad76bab18d response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
53502025-01-09T01:37:59.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a0c4a994-8cae-4815-8aac-33900ab8be40 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53512025-01-09T01:37:59.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a0c4a994-8cae-4815-8aac-33900ab8be40 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53522025-01-09T01:37:59.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a0c4a994-8cae-4815-8aac-33900ab8be40 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53532025-01-09T01:38:00.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53d771e6-ed8a-4705-a035-bbd6fa81caf1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53542025-01-09T01:38:00.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53d771e6-ed8a-4705-a035-bbd6fa81caf1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53552025-01-09T01:38:00.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53d771e6-ed8a-4705-a035-bbd6fa81caf1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53562025-01-09T01:38:01.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c75068e8-e400-47dd-8aae-7e7fc2d39234 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53572025-01-09T01:38:01.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c75068e8-e400-47dd-8aae-7e7fc2d39234 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53582025-01-09T01:38:01.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c75068e8-e400-47dd-8aae-7e7fc2d39234 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53592025-01-09T01:38:02.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 04aa562d-658a-4b8b-9f17-5a3de2fcc94b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53602025-01-09T01:38:02.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 04aa562d-658a-4b8b-9f17-5a3de2fcc94b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53612025-01-09T01:38:02.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 04aa562d-658a-4b8b-9f17-5a3de2fcc94b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53622025-01-09T01:38:03.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc04908d-0977-47e2-b190-cd771c8d7f8c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53632025-01-09T01:38:03.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc04908d-0977-47e2-b190-cd771c8d7f8c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53642025-01-09T01:38:03.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc04908d-0977-47e2-b190-cd771c8d7f8c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53652025-01-09T01:38:04.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fd8ca74c-eeb1-457b-ae23-5397e7ae99f1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53662025-01-09T01:38:04.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fd8ca74c-eeb1-457b-ae23-5397e7ae99f1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53672025-01-09T01:38:04.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fd8ca74c-eeb1-457b-ae23-5397e7ae99f1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53682025-01-09T01:38:05.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 196a44a8-2ac5-44dc-a63c-ff589456c497 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53692025-01-09T01:38:05.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 196a44a8-2ac5-44dc-a63c-ff589456c497 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53702025-01-09T01:38:05.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 196a44a8-2ac5-44dc-a63c-ff589456c497 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53712025-01-09T01:38:06.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
53722025-01-09T01:38:06.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53732025-01-09T01:38:06.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53742025-01-09T01:38:06.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
53752025-01-09T01:38:06.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53762025-01-09T01:38:06.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53772025-01-09T01:38:06.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53782025-01-09T01:38:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53792025-01-09T01:38:06.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.471175ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53802025-01-09T01:38:06.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812025-01-09T01:38:06.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53822025-01-09T01:38:06.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53832025-01-09T01:38:06.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53842025-01-09T01:38:06.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53852025-01-09T01:38:06.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53862025-01-09T01:38:06.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53872025-01-09T01:38:06.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
53882025-01-09T01:38:06.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53892025-01-09T01:38:06.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53902025-01-09T01:38:06.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
53912025-01-09T01:38:06.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.376944ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
53922025-01-09T01:38:06.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6282035a-19ca-482b-9292-a24dacbe7bf0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53932025-01-09T01:38:06.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6282035a-19ca-482b-9292-a24dacbe7bf0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53942025-01-09T01:38:06.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6282035a-19ca-482b-9292-a24dacbe7bf0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53952025-01-09T01:38:07.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58a2d3f5-10ef-4bf7-b6b0-804e4463fc86 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53962025-01-09T01:38:07.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58a2d3f5-10ef-4bf7-b6b0-804e4463fc86 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53972025-01-09T01:38:07.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58a2d3f5-10ef-4bf7-b6b0-804e4463fc86 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53982025-01-09T01:38:08.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 903f0bdc-b36f-4798-831c-4c68f6bd1dc2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
53992025-01-09T01:38:08.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 903f0bdc-b36f-4798-831c-4c68f6bd1dc2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54002025-01-09T01:38:08.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 903f0bdc-b36f-4798-831c-4c68f6bd1dc2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54012025-01-09T01:38:09.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 876 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = ac770277-cc05-474c-929c-4603317cbb4c response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
54022025-01-09T01:38:09.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 375c4ed7-d53d-4164-88d3-ef6c3f4402ab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54032025-01-09T01:38:09.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 375c4ed7-d53d-4164-88d3-ef6c3f4402ab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54042025-01-09T01:38:09.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 375c4ed7-d53d-4164-88d3-ef6c3f4402ab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54052025-01-09T01:38:10.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a21dbd2-29ea-4ec8-9bbd-8cca9f82a759 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54062025-01-09T01:38:10.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a21dbd2-29ea-4ec8-9bbd-8cca9f82a759 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54072025-01-09T01:38:10.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a21dbd2-29ea-4ec8-9bbd-8cca9f82a759 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54082025-01-09T01:38:11.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9facf49-9e75-4616-a0be-5378489025d1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54092025-01-09T01:38:11.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9facf49-9e75-4616-a0be-5378489025d1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54102025-01-09T01:38:11.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9facf49-9e75-4616-a0be-5378489025d1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54112025-01-09T01:38:12.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f54b846c-06fa-4b38-b986-fdb7361641b8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54122025-01-09T01:38:12.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f54b846c-06fa-4b38-b986-fdb7361641b8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54132025-01-09T01:38:12.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f54b846c-06fa-4b38-b986-fdb7361641b8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54142025-01-09T01:38:13.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0da5c81-b196-453e-a33c-5f6d381e4897 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54152025-01-09T01:38:13.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0da5c81-b196-453e-a33c-5f6d381e4897 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54162025-01-09T01:38:13.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0da5c81-b196-453e-a33c-5f6d381e4897 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54172025-01-09T01:38:14.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd094acb-0235-4cb6-b182-b7724346ddac roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54182025-01-09T01:38:14.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd094acb-0235-4cb6-b182-b7724346ddac resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54192025-01-09T01:38:14.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd094acb-0235-4cb6-b182-b7724346ddac response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54202025-01-09T01:38:16.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3874ef2-ce75-4d78-89b9-cd6c7757a31e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54212025-01-09T01:38:16.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3874ef2-ce75-4d78-89b9-cd6c7757a31e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54222025-01-09T01:38:16.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3874ef2-ce75-4d78-89b9-cd6c7757a31e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
54232025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
54242025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54252025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
54262025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
54272025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54282025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
54292025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54302025-01-09T01:38:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54312025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54322025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54332025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
54342025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
54352025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54362025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
54372025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54382025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54392025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54402025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
54412025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54422025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
54432025-01-09T01:38:16.603ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54442025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
54452025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54462025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54472025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
54482025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54492025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
54502025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
54512025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54522025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54532025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54542025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54552025-01-09T01:38:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54562025-01-09T01:38:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54572025-01-09T01:38:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54582025-01-09T01:38:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54592025-01-09T01:38:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54602025-01-09T01:38:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54612025-01-09T01:38:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54622025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
54632025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54642025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
54652025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54662025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54672025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54682025-01-09T01:38:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54692025-01-09T01:38:16.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1229, tv_nsec: 7837857 } })
54702025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
54712025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54722025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
54732025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54742025-01-09T01:38:16.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1229, tv_nsec: 8059730 } })
54752025-01-09T01:38:16.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54762025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54772025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54782025-01-09T01:38:16.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54792025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802025-01-09T01:38:16.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.142277ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54812025-01-09T01:38:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54822025-01-09T01:38:16.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54832025-01-09T01:38:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54842025-01-09T01:38:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54852025-01-09T01:38:16.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54862025-01-09T01:38:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54872025-01-09T01:38:16.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54882025-01-09T01:38:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54892025-01-09T01:38:16.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54902025-01-09T01:38:16.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.509891ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
54912025-01-09T01:38:16.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54922025-01-09T01:38:16.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54932025-01-09T01:38:16.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54942025-01-09T01:38:16.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54952025-01-09T01:38:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54962025-01-09T01:38:16.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54972025-01-09T01:38:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54982025-01-09T01:38:16.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54992025-01-09T01:38:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
55002025-01-09T01:38:16.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55012025-01-09T01:38:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55022025-01-09T01:38:16.638ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
55032025-01-09T01:38:16.638ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.827516ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
55042025-01-09T01:38:16.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55052025-01-09T01:38:16.647ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55062025-01-09T01:38:16.647ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55072025-01-09T01:38:16.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55082025-01-09T01:38:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55092025-01-09T01:38:16.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55102025-01-09T01:38:16.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55112025-01-09T01:38:16.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55122025-01-09T01:38:16.650ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55132025-01-09T01:38:16.651ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55142025-01-09T01:38:16.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55152025-01-09T01:38:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55162025-01-09T01:38:16.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55172025-01-09T01:38:16.653ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55182025-01-09T01:38:16.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55192025-01-09T01:38:16.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55202025-01-09T01:38:16.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55212025-01-09T01:38:16.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55222025-01-09T01:38:16.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.790983ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55232025-01-09T01:38:16.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55242025-01-09T01:38:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55252025-01-09T01:38:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55262025-01-09T01:38:16.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55272025-01-09T01:38:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55282025-01-09T01:38:16.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55292025-01-09T01:38:16.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55302025-01-09T01:38:16.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55312025-01-09T01:38:16.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55322025-01-09T01:38:16.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55332025-01-09T01:38:16.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55342025-01-09T01:38:16.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55352025-01-09T01:38:16.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55362025-01-09T01:38:16.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372025-01-09T01:38:16.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55382025-01-09T01:38:16.660ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1229, tv_nsec: 62390904 } })
55392025-01-09T01:38:16.660ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
55402025-01-09T01:38:16.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55412025-01-09T01:38:16.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55422025-01-09T01:38:16.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55432025-01-09T01:38:16.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55442025-01-09T01:38:16.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55452025-01-09T01:38:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
55462025-01-09T01:38:16.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55472025-01-09T01:38:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55482025-01-09T01:38:16.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55492025-01-09T01:38:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55502025-01-09T01:38:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55512025-01-09T01:38:16.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.044726ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
55522025-01-09T01:38:16.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55532025-01-09T01:38:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55542025-01-09T01:38:16.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.098421ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55552025-01-09T01:38:16.668ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.465007ms iteration = 10 status = 0
55562025-01-09T01:38:16.671ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55572025-01-09T01:38:16.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.71146ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55582025-01-09T01:38:16.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55592025-01-09T01:38:16.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55602025-01-09T01:38:16.690ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55612025-01-09T01:38:16.690ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55622025-01-09T01:38:16.691ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2b44bcd-f5e2-4e33-b44f-b5b3e1aca4d2", "content-length": "26", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
55632025-01-09T01:38:16.691ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55642025-01-09T01:38:16.693ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55652025-01-09T01:38:16.705ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55662025-01-09T01:38:16.705ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55672025-01-09T01:38:16.705ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.697506ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55682025-01-09T01:38:16.706ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.286283ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
55692025-01-09T01:38:16.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55702025-01-09T01:38:16.719ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55712025-01-09T01:38:16.719ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0543110d-af71-43f6-a147-067e26f289f9", "content-length": "26", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
55722025-01-09T01:38:16.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55732025-01-09T01:38:16.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55742025-01-09T01:38:16.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.138597ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55752025-01-09T01:38:16.774ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
55762025-01-09T01:38:16.774ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55772025-01-09T01:38:16.775ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5b25c34-2f5c-4b44-9a81-03cf8fe4175c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
55782025-01-09T01:38:16.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55792025-01-09T01:38:16.776ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
55802025-01-09T01:38:16.792ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.485201ms iteration = 12 status = {"physical_disks_added":0}
55812025-01-09T01:38:16.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55822025-01-09T01:38:16.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55832025-01-09T01:38:16.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55842025-01-09T01:38:16.804ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55852025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55862025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55872025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55882025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55892025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c03d18ce-e58e-4557-9159-af01575b0bdb", "content-length": "372", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
55902025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55912025-01-09T01:38:16.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55922025-01-09T01:38:16.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55932025-01-09T01:38:16.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55942025-01-09T01:38:16.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55952025-01-09T01:38:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55962025-01-09T01:38:16.818ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55972025-01-09T01:38:16.818ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55982025-01-09T01:38:16.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27c07bc9-84ff-4af9-b257-3ddda76570d6", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
55992025-01-09T01:38:16.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56002025-01-09T01:38:16.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56012025-01-09T01:38:16.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56022025-01-09T01:38:16.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56032025-01-09T01:38:16.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56042025-01-09T01:38:16.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56052025-01-09T01:38:16.828ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56062025-01-09T01:38:16.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56072025-01-09T01:38:16.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a3b7aa3-19da-4de5-9963-0e706d18ad53", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56082025-01-09T01:38:16.830ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 226.493634ms iteration = 10 status = {}
56092025-01-09T01:38:16.839ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.701907ms iteration = 10 status = {}
56102025-01-09T01:38:16.858ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56112025-01-09T01:38:16.858ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "757bb498-b061-4989-ba99-b1c1edadebc5", "content-length": "1", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56122025-01-09T01:38:16.860ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56132025-01-09T01:38:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56142025-01-09T01:38:16.863ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 260.553691ms iteration = 10 status = null
56152025-01-09T01:38:16.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56162025-01-09T01:38:16.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4518dcbb-90b6-4886-95b2-77b97f285390", "content-length": "691", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56172025-01-09T01:38:16.894ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56182025-01-09T01:38:16.894ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56192025-01-09T01:38:16.894ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56202025-01-09T01:38:16.895ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.971026ms iteration = 10 status = {}
56212025-01-09T01:38:16.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56222025-01-09T01:38:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56232025-01-09T01:38:16.976ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
56242025-01-09T01:38:16.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56252025-01-09T01:38:16.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56262025-01-09T01:38:16.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56272025-01-09T01:38:16.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ea182a-c6f0-4918-98e6-c857644671bb", "content-length": "134", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56282025-01-09T01:38:16.988ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56292025-01-09T01:38:16.988ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
56302025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56312025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56322025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56332025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56342025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56352025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56362025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56372025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56382025-01-09T01:38:16.989ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
56392025-01-09T01:38:16.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402025-01-09T01:38:16.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412025-01-09T01:38:16.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56422025-01-09T01:38:16.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9f948cc-edcc-427d-8d82-d1e35c8bc108", "content-length": "2", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56432025-01-09T01:38:16.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56442025-01-09T01:38:16.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1ea5c5c-f43f-46ad-9b2b-d59b84de348e", "content-length": "52", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56452025-01-09T01:38:16.992ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
56462025-01-09T01:38:16.992ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56472025-01-09T01:38:17.095ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f637d6a0-10cf-4271-9272-6016172b6324", "date": "Thu, 09 Jan 2025 01:38:16 GMT"} })
56482025-01-09T01:38:17.095ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
56492025-01-09T01:38:17.095ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56502025-01-09T01:38:17.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3ef4686-14e5-4d45-b637-2f4cb5c3a6ab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56512025-01-09T01:38:17.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3ef4686-14e5-4d45-b637-2f4cb5c3a6ab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56522025-01-09T01:38:17.096ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b951d0-905c-4e06-92be-350950e770b5", "content-length": "682", "date": "Thu, 09 Jan 2025 01:38:17 GMT"} })
56532025-01-09T01:38:17.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56542025-01-09T01:38:17.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56552025-01-09T01:38:17.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3ef4686-14e5-4d45-b637-2f4cb5c3a6ab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56562025-01-09T01:38:17.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56572025-01-09T01:38:17.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56582025-01-09T01:38:17.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56592025-01-09T01:38:17.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56602025-01-09T01:38:17.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56612025-01-09T01:38:17.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56622025-01-09T01:38:17.111ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.837809ms iteration = 10 status = {}
56632025-01-09T01:38:17.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b42bfab8-4902-4052-ac7a-5802445cf6a3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
56642025-01-09T01:38:17.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b42bfab8-4902-4052-ac7a-5802445cf6a3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
56652025-01-09T01:38:17.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b42bfab8-4902-4052-ac7a-5802445cf6a3 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
56662025-01-09T01:38:18.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b2e9c157-a86a-4625-8052-b7c6dd2e9d4b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56672025-01-09T01:38:18.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b2e9c157-a86a-4625-8052-b7c6dd2e9d4b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56682025-01-09T01:38:18.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b2e9c157-a86a-4625-8052-b7c6dd2e9d4b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56692025-01-09T01:38:19.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be762a81-4b9d-4714-a8b9-daf9387ba091 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56702025-01-09T01:38:19.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be762a81-4b9d-4714-a8b9-daf9387ba091 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56712025-01-09T01:38:19.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be762a81-4b9d-4714-a8b9-daf9387ba091 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56722025-01-09T01:38:19.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 631 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 306fe3ef-f3a8-474b-a548-29aa57d9e1e2 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
56732025-01-09T01:38:20.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e9280e4-3755-423f-9dd5-d0530deed379 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56742025-01-09T01:38:20.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e9280e4-3755-423f-9dd5-d0530deed379 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56752025-01-09T01:38:20.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e9280e4-3755-423f-9dd5-d0530deed379 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56762025-01-09T01:38:21.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75bd673b-1b7b-4259-b114-19423797a6ff roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56772025-01-09T01:38:21.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75bd673b-1b7b-4259-b114-19423797a6ff resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56782025-01-09T01:38:21.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75bd673b-1b7b-4259-b114-19423797a6ff response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56792025-01-09T01:38:22.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4980fd0f-1e45-4b1e-add6-2deb1e8758ef roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56802025-01-09T01:38:22.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4980fd0f-1e45-4b1e-add6-2deb1e8758ef resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56812025-01-09T01:38:22.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4980fd0f-1e45-4b1e-add6-2deb1e8758ef response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56822025-01-09T01:38:23.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d351aff-3905-4f05-9179-3644a30b13bf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56832025-01-09T01:38:23.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d351aff-3905-4f05-9179-3644a30b13bf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56842025-01-09T01:38:23.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d351aff-3905-4f05-9179-3644a30b13bf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56852025-01-09T01:38:24.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ac1bc6fe-2d18-435e-85fb-e37d6f2e33c8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56862025-01-09T01:38:24.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ac1bc6fe-2d18-435e-85fb-e37d6f2e33c8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56872025-01-09T01:38:24.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ac1bc6fe-2d18-435e-85fb-e37d6f2e33c8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56882025-01-09T01:38:25.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e4e312ea-7687-4be7-a485-591990abc04f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56892025-01-09T01:38:25.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e4e312ea-7687-4be7-a485-591990abc04f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56902025-01-09T01:38:25.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e4e312ea-7687-4be7-a485-591990abc04f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56912025-01-09T01:38:26.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 12609d40-ba5b-47e8-b656-30a64ad80eff roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56922025-01-09T01:38:26.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 12609d40-ba5b-47e8-b656-30a64ad80eff resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56932025-01-09T01:38:26.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 12609d40-ba5b-47e8-b656-30a64ad80eff response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
56942025-01-09T01:38:26.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
56952025-01-09T01:38:26.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56962025-01-09T01:38:26.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56972025-01-09T01:38:26.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
56982025-01-09T01:38:26.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56992025-01-09T01:38:26.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57002025-01-09T01:38:26.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57012025-01-09T01:38:26.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57022025-01-09T01:38:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57032025-01-09T01:38:26.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.378764ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57042025-01-09T01:38:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57052025-01-09T01:38:26.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57062025-01-09T01:38:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57072025-01-09T01:38:26.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082025-01-09T01:38:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092025-01-09T01:38:26.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102025-01-09T01:38:26.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
57112025-01-09T01:38:26.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57122025-01-09T01:38:26.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57132025-01-09T01:38:26.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
57142025-01-09T01:38:26.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.9275ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
57152025-01-09T01:38:27.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 327312a1-63a3-46c2-a203-a6d471a34814 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57162025-01-09T01:38:27.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 327312a1-63a3-46c2-a203-a6d471a34814 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57172025-01-09T01:38:27.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 327312a1-63a3-46c2-a203-a6d471a34814 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57182025-01-09T01:38:28.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 52494fa5-3976-4b08-b35e-6927094981d1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57192025-01-09T01:38:28.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 52494fa5-3976-4b08-b35e-6927094981d1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57202025-01-09T01:38:28.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 52494fa5-3976-4b08-b35e-6927094981d1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57212025-01-09T01:38:29.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 46e4b752-0ae7-4e0f-9461-e066a651c13d roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
57222025-01-09T01:38:29.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 46e4b752-0ae7-4e0f-9461-e066a651c13d resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
57232025-01-09T01:38:29.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 46e4b752-0ae7-4e0f-9461-e066a651c13d response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
57242025-01-09T01:38:29.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 48a2eb1b-78dc-4d87-9eda-6ccdade0047a roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
57252025-01-09T01:38:29.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 48a2eb1b-78dc-4d87-9eda-6ccdade0047a resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
57262025-01-09T01:38:29.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 48a2eb1b-78dc-4d87-9eda-6ccdade0047a response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
57272025-01-09T01:38:29.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 3638562e-956b-4a9e-adea-a609808ce378 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
57282025-01-09T01:38:29.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 24af6847-241a-49ea-9ef2-975a69427e3a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57292025-01-09T01:38:29.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 24af6847-241a-49ea-9ef2-975a69427e3a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57302025-01-09T01:38:29.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 24af6847-241a-49ea-9ef2-975a69427e3a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57312025-01-09T01:38:30.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 774e13e6-8f07-4dce-81f2-981b6cf4e027 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57322025-01-09T01:38:30.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 774e13e6-8f07-4dce-81f2-981b6cf4e027 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57332025-01-09T01:38:30.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 774e13e6-8f07-4dce-81f2-981b6cf4e027 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57342025-01-09T01:38:31.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be6c71c1-cff9-4b88-ae02-ed235b6a4bbc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57352025-01-09T01:38:31.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be6c71c1-cff9-4b88-ae02-ed235b6a4bbc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57362025-01-09T01:38:31.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be6c71c1-cff9-4b88-ae02-ed235b6a4bbc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57372025-01-09T01:38:32.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a862f2c4-d940-4bc3-a41d-6f190ff6914f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57382025-01-09T01:38:32.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a862f2c4-d940-4bc3-a41d-6f190ff6914f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57392025-01-09T01:38:32.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a862f2c4-d940-4bc3-a41d-6f190ff6914f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57402025-01-09T01:38:33.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f33cdbf4-f40c-4885-a01e-3b3066064fab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57412025-01-09T01:38:33.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f33cdbf4-f40c-4885-a01e-3b3066064fab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57422025-01-09T01:38:33.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f33cdbf4-f40c-4885-a01e-3b3066064fab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57432025-01-09T01:38:34.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95e7a9fb-89de-4688-ac5e-28a69963f281 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57442025-01-09T01:38:34.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95e7a9fb-89de-4688-ac5e-28a69963f281 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57452025-01-09T01:38:34.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95e7a9fb-89de-4688-ac5e-28a69963f281 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57462025-01-09T01:38:35.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1ec53e1d-1ec3-48c8-8dc4-2761caecf051 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57472025-01-09T01:38:35.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1ec53e1d-1ec3-48c8-8dc4-2761caecf051 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57482025-01-09T01:38:35.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1ec53e1d-1ec3-48c8-8dc4-2761caecf051 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57492025-01-09T01:38:36.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 67b4726f-989a-4817-90b0-2d22d39299cf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57502025-01-09T01:38:36.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 67b4726f-989a-4817-90b0-2d22d39299cf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57512025-01-09T01:38:36.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 67b4726f-989a-4817-90b0-2d22d39299cf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57522025-01-09T01:38:36.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
57532025-01-09T01:38:36.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57542025-01-09T01:38:36.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57552025-01-09T01:38:36.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
57562025-01-09T01:38:36.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57572025-01-09T01:38:36.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57582025-01-09T01:38:36.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57592025-01-09T01:38:36.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57602025-01-09T01:38:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57612025-01-09T01:38:36.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.044835ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57622025-01-09T01:38:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57632025-01-09T01:38:36.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57642025-01-09T01:38:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57652025-01-09T01:38:36.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57662025-01-09T01:38:36.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57672025-01-09T01:38:36.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682025-01-09T01:38:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
57692025-01-09T01:38:36.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57702025-01-09T01:38:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57712025-01-09T01:38:36.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
57722025-01-09T01:38:36.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.614323ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
57732025-01-09T01:38:37.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ba6378fc-3a33-41ab-a8e1-340afc0e35c6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57742025-01-09T01:38:37.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ba6378fc-3a33-41ab-a8e1-340afc0e35c6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57752025-01-09T01:38:37.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ba6378fc-3a33-41ab-a8e1-340afc0e35c6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57762025-01-09T01:38:38.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = afe7680b-82c5-4184-a45f-7be8b428c108 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57772025-01-09T01:38:38.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = afe7680b-82c5-4184-a45f-7be8b428c108 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57782025-01-09T01:38:38.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = afe7680b-82c5-4184-a45f-7be8b428c108 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57792025-01-09T01:38:39.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 987 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = aad3a710-95e5-444d-8ea9-8b111cb8f91d response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
57802025-01-09T01:38:39.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ac630c3-e061-4221-b87c-19c19e859a59 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57812025-01-09T01:38:39.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ac630c3-e061-4221-b87c-19c19e859a59 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57822025-01-09T01:38:39.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ac630c3-e061-4221-b87c-19c19e859a59 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57832025-01-09T01:38:40.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5139292-ca50-4179-9fa7-7aec6405e82b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57842025-01-09T01:38:40.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5139292-ca50-4179-9fa7-7aec6405e82b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57852025-01-09T01:38:40.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5139292-ca50-4179-9fa7-7aec6405e82b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57862025-01-09T01:38:41.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95851e3d-9622-478d-9fd5-ee3c4bc18d93 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57872025-01-09T01:38:41.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95851e3d-9622-478d-9fd5-ee3c4bc18d93 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57882025-01-09T01:38:41.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95851e3d-9622-478d-9fd5-ee3c4bc18d93 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57892025-01-09T01:38:42.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ef8af4c7-87cc-4132-941b-41c106e2c4ff roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57902025-01-09T01:38:42.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ef8af4c7-87cc-4132-941b-41c106e2c4ff resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57912025-01-09T01:38:42.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ef8af4c7-87cc-4132-941b-41c106e2c4ff response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57922025-01-09T01:38:43.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf0ad434-13f1-432a-9d3a-ad5fa6d6626a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57932025-01-09T01:38:43.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf0ad434-13f1-432a-9d3a-ad5fa6d6626a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57942025-01-09T01:38:43.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf0ad434-13f1-432a-9d3a-ad5fa6d6626a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57952025-01-09T01:38:44.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 100932b9-107f-4e42-911a-64ee6f23f739 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57962025-01-09T01:38:44.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 100932b9-107f-4e42-911a-64ee6f23f739 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57972025-01-09T01:38:44.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 100932b9-107f-4e42-911a-64ee6f23f739 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57982025-01-09T01:38:45.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 14d31c99-d3e8-4656-87a1-1e6b12bc3479 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
57992025-01-09T01:38:45.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 14d31c99-d3e8-4656-87a1-1e6b12bc3479 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
58002025-01-09T01:38:45.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 14d31c99-d3e8-4656-87a1-1e6b12bc3479 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
58012025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
58022025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
58032025-01-09T01:38:46.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
58042025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.771\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
58052025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
58062025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
58072025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
58082025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58092025-01-09T01:38:46.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:28:46.603097524 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58102025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58112025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
58122025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
58132025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
58142025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58152025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
58162025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
58172025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
58182025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
58192025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58202025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58212025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
58222025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
58232025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58242025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58252025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58262025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58272025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58282025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58292025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
58302025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
58312025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58322025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58332025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
58342025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58352025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58362025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58372025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58382025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
58392025-01-09T01:38:46.603ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
58402025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
58412025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58422025-01-09T01:38:46.603ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58432025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
58442025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58452025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58462025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58472025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
58482025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
58492025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58502025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58512025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
58522025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58532025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58542025-01-09T01:38:46.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 5192644 } })
58552025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
58562025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58572025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
58582025-01-09T01:38:46.603ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
58592025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58602025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
58612025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58622025-01-09T01:38:46.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 5255835 } })
58632025-01-09T01:38:46.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58642025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58652025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58662025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58672025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58682025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58692025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58702025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58712025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58722025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58732025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
58742025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.170249ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
58752025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58762025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58772025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
58782025-01-09T01:38:46.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.291741ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
58792025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58802025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58812025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
58822025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
58832025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58842025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58852025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
58862025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58872025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
58882025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58892025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58902025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58912025-01-09T01:38:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58922025-01-09T01:38:46.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 7424260 } })
58932025-01-09T01:38:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58942025-01-09T01:38:46.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58952025-01-09T01:38:46.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58962025-01-09T01:38:46.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58972025-01-09T01:38:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58982025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.921714ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58992025-01-09T01:38:46.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:28:46.603097524 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59002025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.207927ms iteration = 6 status = {"expiration":"2025-01-09T01:28:46.603097524Z","pruned":[]}
59012025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
59022025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
59032025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59042025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59052025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59062025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59072025-01-09T01:38:46.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59082025-01-09T01:38:46.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59092025-01-09T01:38:46.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59102025-01-09T01:38:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59112025-01-09T01:38:46.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 11922903 } })
59122025-01-09T01:38:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59132025-01-09T01:38:46.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59142025-01-09T01:38:46.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
59152025-01-09T01:38:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59162025-01-09T01:38:46.611ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59172025-01-09T01:38:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59182025-01-09T01:38:46.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59192025-01-09T01:38:46.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59202025-01-09T01:38:46.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59212025-01-09T01:38:46.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59222025-01-09T01:38:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59232025-01-09T01:38:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59242025-01-09T01:38:46.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59252025-01-09T01:38:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59262025-01-09T01:38:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59272025-01-09T01:38:46.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59282025-01-09T01:38:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59292025-01-09T01:38:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59302025-01-09T01:38:46.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59312025-01-09T01:38:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59322025-01-09T01:38:46.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59332025-01-09T01:38:46.622ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.429814ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
59342025-01-09T01:38:46.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59352025-01-09T01:38:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
59362025-01-09T01:38:46.623ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59372025-01-09T01:38:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59382025-01-09T01:38:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59392025-01-09T01:38:46.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59402025-01-09T01:38:46.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59412025-01-09T01:38:46.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59422025-01-09T01:38:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59432025-01-09T01:38:46.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59442025-01-09T01:38:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59452025-01-09T01:38:46.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59462025-01-09T01:38:46.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59472025-01-09T01:38:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59482025-01-09T01:38:46.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59492025-01-09T01:38:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59502025-01-09T01:38:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59512025-01-09T01:38:46.633ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59522025-01-09T01:38:46.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.386153ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59532025-01-09T01:38:46.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59542025-01-09T01:38:46.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59552025-01-09T01:38:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59562025-01-09T01:38:46.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59572025-01-09T01:38:46.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59582025-01-09T01:38:46.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59592025-01-09T01:38:46.647ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59602025-01-09T01:38:46.647ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59612025-01-09T01:38:46.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59622025-01-09T01:38:46.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59632025-01-09T01:38:46.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59642025-01-09T01:38:46.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59652025-01-09T01:38:46.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59662025-01-09T01:38:46.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59672025-01-09T01:38:46.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59682025-01-09T01:38:46.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59692025-01-09T01:38:46.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59702025-01-09T01:38:46.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59712025-01-09T01:38:46.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.722458ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59722025-01-09T01:38:46.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59732025-01-09T01:38:46.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59742025-01-09T01:38:46.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59752025-01-09T01:38:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59762025-01-09T01:38:46.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59772025-01-09T01:38:46.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59782025-01-09T01:38:46.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59792025-01-09T01:38:46.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59802025-01-09T01:38:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59812025-01-09T01:38:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59822025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59832025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59842025-01-09T01:38:46.663ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59852025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59862025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59872025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59882025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59892025-01-09T01:38:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59902025-01-09T01:38:46.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59912025-01-09T01:38:46.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922025-01-09T01:38:46.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932025-01-09T01:38:46.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59942025-01-09T01:38:46.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59952025-01-09T01:38:46.669ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59962025-01-09T01:38:46.669ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59972025-01-09T01:38:46.669ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.820177ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59982025-01-09T01:38:46.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59992025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60002025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60012025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60022025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60032025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60042025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60052025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60062025-01-09T01:38:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60072025-01-09T01:38:46.672ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60082025-01-09T01:38:46.672ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60092025-01-09T01:38:46.672ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60102025-01-09T01:38:46.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60112025-01-09T01:38:46.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60122025-01-09T01:38:46.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60132025-01-09T01:38:46.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60142025-01-09T01:38:46.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60152025-01-09T01:38:46.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.724985ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
60162025-01-09T01:38:46.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.441025ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
60172025-01-09T01:38:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
60182025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60192025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60202025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
60212025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60222025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60232025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.618846ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60242025-01-09T01:38:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60252025-01-09T01:38:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60262025-01-09T01:38:46.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60272025-01-09T01:38:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60282025-01-09T01:38:46.681ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
60292025-01-09T01:38:46.681ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
60302025-01-09T01:38:46.681ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.7031ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
60312025-01-09T01:38:46.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60322025-01-09T01:38:46.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60332025-01-09T01:38:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60342025-01-09T01:38:46.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.933018ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60352025-01-09T01:38:46.686ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1259, tv_nsec: 88038587 } })
60362025-01-09T01:38:46.687ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
60372025-01-09T01:38:46.703ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
60382025-01-09T01:38:46.703ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 99.788926ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60392025-01-09T01:38:46.711ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
60402025-01-09T01:38:46.711ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.671878ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
60412025-01-09T01:38:46.717ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60422025-01-09T01:38:46.717ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60432025-01-09T01:38:46.717ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60442025-01-09T01:38:46.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60452025-01-09T01:38:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60462025-01-09T01:38:46.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60472025-01-09T01:38:46.734ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60482025-01-09T01:38:46.734ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60492025-01-09T01:38:46.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.55315ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60502025-01-09T01:38:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60512025-01-09T01:38:46.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60522025-01-09T01:38:46.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60532025-01-09T01:38:46.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0696ea5-ce42-4871-8c10-5c37c9b49c00 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
60542025-01-09T01:38:46.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0696ea5-ce42-4871-8c10-5c37c9b49c00 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
60552025-01-09T01:38:46.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60562025-01-09T01:38:46.743ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.634586ms iteration = 13 status = {"physical_disks_added":0}
60572025-01-09T01:38:46.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60582025-01-09T01:38:46.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60592025-01-09T01:38:46.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60602025-01-09T01:38:46.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60612025-01-09T01:38:46.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60622025-01-09T01:38:46.764ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60632025-01-09T01:38:46.765ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60642025-01-09T01:38:46.765ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60652025-01-09T01:38:46.765ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbd2a1c-eed7-4d5d-916e-f662a7cb6f8d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
60662025-01-09T01:38:46.765ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60672025-01-09T01:38:46.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60682025-01-09T01:38:46.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60692025-01-09T01:38:46.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60702025-01-09T01:38:46.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60712025-01-09T01:38:46.804ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60722025-01-09T01:38:46.805ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b66b74a4-9c68-4457-9675-54f1a1e217ef", "content-length": "26", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
60732025-01-09T01:38:46.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60742025-01-09T01:38:46.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60752025-01-09T01:38:46.844ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60762025-01-09T01:38:46.863ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
60772025-01-09T01:38:46.863ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60782025-01-09T01:38:46.864ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad1ced4e-5033-47d7-9190-98b603b0dd47", "content-length": "26", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
60792025-01-09T01:38:46.864ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60802025-01-09T01:38:46.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
60812025-01-09T01:38:47.046ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60822025-01-09T01:38:47.047ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "655810eb-baeb-4d9a-9240-4fe67560f5c5", "content-length": "691", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
60832025-01-09T01:38:47.047ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60842025-01-09T01:38:47.047ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60852025-01-09T01:38:47.047ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60862025-01-09T01:38:47.049ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 445.997484ms iteration = 11 status = {}
60872025-01-09T01:38:47.122ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60882025-01-09T01:38:47.123ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c80b1de9-40da-4518-9968-fdf8dc021e9b", "content-length": "1", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
60892025-01-09T01:38:47.124ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60902025-01-09T01:38:47.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60912025-01-09T01:38:47.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60922025-01-09T01:38:47.132ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0469951a-6d13-4f01-a329-77a4b2d46930", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60932025-01-09T01:38:47.132ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60942025-01-09T01:38:47.134ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e7eb6126-f13c-4b1d-a9c8-55cff230b02f", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60952025-01-09T01:38:47.134ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60962025-01-09T01:38:47.136ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60972025-01-09T01:38:47.136ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 533.393731ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60982025-01-09T01:38:47.199ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 596.135729ms iteration = 11 status = {}
60992025-01-09T01:38:47.207ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
61002025-01-09T01:38:47.224ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61012025-01-09T01:38:47.224ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61022025-01-09T01:38:47.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61032025-01-09T01:38:47.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61042025-01-09T01:38:47.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61052025-01-09T01:38:47.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61062025-01-09T01:38:47.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0696ea5-ce42-4871-8c10-5c37c9b49c00 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
61072025-01-09T01:38:47.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61082025-01-09T01:38:47.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61092025-01-09T01:38:47.235ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 632.412613ms iteration = 11 status = null
61102025-01-09T01:38:47.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61112025-01-09T01:38:47.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
61122025-01-09T01:38:47.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61132025-01-09T01:38:47.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61142025-01-09T01:38:47.245ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 642.17283ms iteration = 11 status = 0
61152025-01-09T01:38:47.267ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61162025-01-09T01:38:47.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 663.267229ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61172025-01-09T01:38:47.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 660.794319ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61182025-01-09T01:38:47.268ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61192025-01-09T01:38:47.268ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
61202025-01-09T01:38:47.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61212025-01-09T01:38:47.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61222025-01-09T01:38:47.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232025-01-09T01:38:47.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61242025-01-09T01:38:47.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61252025-01-09T01:38:47.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61262025-01-09T01:38:47.273ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
61272025-01-09T01:38:47.273ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61282025-01-09T01:38:47.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61292025-01-09T01:38:47.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61302025-01-09T01:38:47.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61312025-01-09T01:38:47.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61322025-01-09T01:38:47.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61332025-01-09T01:38:47.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61342025-01-09T01:38:47.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61352025-01-09T01:38:47.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61362025-01-09T01:38:47.279ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
61372025-01-09T01:38:47.279ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
61382025-01-09T01:38:47.279ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
61392025-01-09T01:38:47.279ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 676.398051ms iteration = 6 status = {"generation":2}
61402025-01-09T01:38:47.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbda459e-8dfb-421e-b67a-2c6e3cd1fe2a", "content-length": "372", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
61412025-01-09T01:38:47.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61422025-01-09T01:38:47.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61432025-01-09T01:38:47.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61442025-01-09T01:38:47.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61452025-01-09T01:38:47.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61462025-01-09T01:38:47.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61472025-01-09T01:38:47.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61482025-01-09T01:38:47.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61492025-01-09T01:38:47.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61502025-01-09T01:38:47.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61512025-01-09T01:38:47.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61522025-01-09T01:38:47.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61532025-01-09T01:38:47.295ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61542025-01-09T01:38:47.295ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fddc7015-2e39-43ed-8314-3323132a8f3d", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61552025-01-09T01:38:47.296ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61562025-01-09T01:38:47.298ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5941efa9-96e5-456d-b935-eadb4e51fdd3", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61572025-01-09T01:38:47.298ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61582025-01-09T01:38:47.300ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9835d8c9-a259-4787-becf-d6516279e441", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61592025-01-09T01:38:47.300ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61602025-01-09T01:38:47.302ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
61612025-01-09T01:38:47.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 699.338099ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
61622025-01-09T01:38:47.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632025-01-09T01:38:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61642025-01-09T01:38:47.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61652025-01-09T01:38:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61662025-01-09T01:38:47.311ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
61672025-01-09T01:38:47.311ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
61682025-01-09T01:38:47.312ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
61692025-01-09T01:38:47.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 708.818872ms iteration = 6 status = {"generation":1}
61702025-01-09T01:38:47.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61712025-01-09T01:38:47.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61722025-01-09T01:38:47.322ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
61732025-01-09T01:38:47.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61742025-01-09T01:38:47.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61752025-01-09T01:38:47.332ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61762025-01-09T01:38:47.333ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc522193-fe62-42fe-972d-2aef0ca4cf75", "content-length": "134", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
61772025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61782025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
61792025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61802025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61812025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61822025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61832025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61842025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61852025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61862025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61872025-01-09T01:38:47.333ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
61882025-01-09T01:38:47.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61892025-01-09T01:38:47.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61902025-01-09T01:38:47.334ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
61912025-01-09T01:38:47.334ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61922025-01-09T01:38:47.335ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c15a43c-019c-4a27-918b-e6b5f73ff6c5", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
61932025-01-09T01:38:47.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61942025-01-09T01:38:47.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61952025-01-09T01:38:47.335ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61962025-01-09T01:38:47.335ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61972025-01-09T01:38:47.335ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d0f6815-104a-40e5-a9cf-04e6b0a5eed8", "content-length": "2", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
61982025-01-09T01:38:47.335ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61992025-01-09T01:38:47.336ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f6de1b1-556e-4414-ab6d-a85355829e98", "content-length": "52", "date": "Thu, 09 Jan 2025 01:38:46 GMT"} })
62002025-01-09T01:38:47.336ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
62012025-01-09T01:38:47.336ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62022025-01-09T01:38:47.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62032025-01-09T01:38:47.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62042025-01-09T01:38:47.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62052025-01-09T01:38:47.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62062025-01-09T01:38:47.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62072025-01-09T01:38:47.344ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62082025-01-09T01:38:47.344ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62092025-01-09T01:38:47.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102025-01-09T01:38:47.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62112025-01-09T01:38:47.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62122025-01-09T01:38:47.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62132025-01-09T01:38:47.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62142025-01-09T01:38:47.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62152025-01-09T01:38:47.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62162025-01-09T01:38:47.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62172025-01-09T01:38:47.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62182025-01-09T01:38:47.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62192025-01-09T01:38:47.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62202025-01-09T01:38:47.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62212025-01-09T01:38:47.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62222025-01-09T01:38:47.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62232025-01-09T01:38:47.433ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2c15a52-a087-443f-87ff-d98a9bb931d5", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
62242025-01-09T01:38:47.433ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
62252025-01-09T01:38:47.433ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62262025-01-09T01:38:47.433ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6074c313-229b-457f-9f3c-0472c5591b59", "content-length": "682", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
62272025-01-09T01:38:47.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62282025-01-09T01:38:47.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62292025-01-09T01:38:47.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62302025-01-09T01:38:47.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62312025-01-09T01:38:47.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62322025-01-09T01:38:47.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62332025-01-09T01:38:47.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62342025-01-09T01:38:47.439ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a061b1f0-a67a-440e-ba13-a8b4ca8ac971", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
62352025-01-09T01:38:47.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62362025-01-09T01:38:47.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62372025-01-09T01:38:47.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
62382025-01-09T01:38:47.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62392025-01-09T01:38:47.441ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 837.630674ms iteration = 11 status = {}
62402025-01-09T01:38:47.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62412025-01-09T01:38:47.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62422025-01-09T01:38:47.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62432025-01-09T01:38:47.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62442025-01-09T01:38:47.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62452025-01-09T01:38:47.450ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 846.919183ms iteration = 11 status = {}
62462025-01-09T01:38:47.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62472025-01-09T01:38:47.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62482025-01-09T01:38:47.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492025-01-09T01:38:47.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
62502025-01-09T01:38:47.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62512025-01-09T01:38:47.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62522025-01-09T01:38:47.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62532025-01-09T01:38:47.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62542025-01-09T01:38:47.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62552025-01-09T01:38:47.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62562025-01-09T01:38:47.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62572025-01-09T01:38:47.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62582025-01-09T01:38:47.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62592025-01-09T01:38:47.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62602025-01-09T01:38:47.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62612025-01-09T01:38:47.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62622025-01-09T01:38:47.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62632025-01-09T01:38:47.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62642025-01-09T01:38:47.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62652025-01-09T01:38:47.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62662025-01-09T01:38:47.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62672025-01-09T01:38:47.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
62682025-01-09T01:38:47.525ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62692025-01-09T01:38:47.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62702025-01-09T01:38:47.526ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62712025-01-09T01:38:47.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62722025-01-09T01:38:47.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62732025-01-09T01:38:47.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62742025-01-09T01:38:47.529ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62752025-01-09T01:38:47.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
62762025-01-09T01:38:47.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62772025-01-09T01:38:47.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62782025-01-09T01:38:47.540ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
62792025-01-09T01:38:47.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62802025-01-09T01:38:47.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62812025-01-09T01:38:47.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822025-01-09T01:38:47.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
62832025-01-09T01:38:47.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62842025-01-09T01:38:47.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62852025-01-09T01:38:47.546ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
62862025-01-09T01:38:47.546ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
62872025-01-09T01:38:47.546ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
62882025-01-09T01:38:47.658ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, time_created: 2025-01-09T01:34:22.988660Z, time_modified: 2025-01-09T01:34:22.988660Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
62892025-01-09T01:38:47.658ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
62902025-01-09T01:38:47.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62912025-01-09T01:38:47.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62922025-01-09T01:38:47.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62932025-01-09T01:38:47.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62942025-01-09T01:38:47.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952025-01-09T01:38:47.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
62962025-01-09T01:38:47.695ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
62972025-01-09T01:38:47.695ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6c8704ed-cdbb-4521-9f55-5489aee112e6", "date": "Thu, 09 Jan 2025 01:38:47 GMT"} })
62982025-01-09T01:38:47.697ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
62992025-01-09T01:38:47.697ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.093407938s
63002025-01-09T01:38:47.697ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.093414708s iteration = 2 status = {}
63012025-01-09T01:38:47.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f867e36b-f548-41bb-b093-6e3cf5171c65 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
63022025-01-09T01:38:47.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f867e36b-f548-41bb-b093-6e3cf5171c65 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
63032025-01-09T01:38:47.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f867e36b-f548-41bb-b093-6e3cf5171c65 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
63042025-01-09T01:38:48.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f9671fdf-0cb5-4c9f-8f1a-33178a72a62c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63052025-01-09T01:38:48.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f9671fdf-0cb5-4c9f-8f1a-33178a72a62c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63062025-01-09T01:38:48.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f9671fdf-0cb5-4c9f-8f1a-33178a72a62c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63072025-01-09T01:38:49.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = b7c27aba-7662-4d60-831b-e5913d3601b6 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
63082025-01-09T01:38:49.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5cb0526-690d-47ca-8bf9-a7d38e6df978 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63092025-01-09T01:38:49.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5cb0526-690d-47ca-8bf9-a7d38e6df978 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63102025-01-09T01:38:49.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5cb0526-690d-47ca-8bf9-a7d38e6df978 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63112025-01-09T01:38:50.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8d4e0a50-c947-4213-9d50-3770eeb11c88 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63122025-01-09T01:38:50.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8d4e0a50-c947-4213-9d50-3770eeb11c88 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63132025-01-09T01:38:50.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8d4e0a50-c947-4213-9d50-3770eeb11c88 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63142025-01-09T01:38:51.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e7d1c66f-9ea5-4eea-90b2-9358fbb48b4b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63152025-01-09T01:38:51.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e7d1c66f-9ea5-4eea-90b2-9358fbb48b4b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63162025-01-09T01:38:51.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e7d1c66f-9ea5-4eea-90b2-9358fbb48b4b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63172025-01-09T01:38:52.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 12338369-875b-44fe-b3ae-730002fd520e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63182025-01-09T01:38:52.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 12338369-875b-44fe-b3ae-730002fd520e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63192025-01-09T01:38:52.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 12338369-875b-44fe-b3ae-730002fd520e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63202025-01-09T01:38:53.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5e3c7618-8af4-4eb7-ade3-1717e663d133 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63212025-01-09T01:38:53.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5e3c7618-8af4-4eb7-ade3-1717e663d133 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63222025-01-09T01:38:53.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5e3c7618-8af4-4eb7-ade3-1717e663d133 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63232025-01-09T01:38:54.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 865d2faa-d22e-4775-9f95-59ed3d92ea2d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63242025-01-09T01:38:54.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 865d2faa-d22e-4775-9f95-59ed3d92ea2d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63252025-01-09T01:38:54.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 865d2faa-d22e-4775-9f95-59ed3d92ea2d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63262025-01-09T01:38:55.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 15c92228-d5f9-4fce-9add-d39fa7b4bb88 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63272025-01-09T01:38:55.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 15c92228-d5f9-4fce-9add-d39fa7b4bb88 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63282025-01-09T01:38:55.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 15c92228-d5f9-4fce-9add-d39fa7b4bb88 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63292025-01-09T01:38:56.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 659e1ea5-2f92-4b02-88ca-446852b5d260 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63302025-01-09T01:38:56.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 659e1ea5-2f92-4b02-88ca-446852b5d260 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63312025-01-09T01:38:56.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 659e1ea5-2f92-4b02-88ca-446852b5d260 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63322025-01-09T01:38:56.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
63332025-01-09T01:38:56.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63342025-01-09T01:38:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63352025-01-09T01:38:56.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
63362025-01-09T01:38:56.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63372025-01-09T01:38:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63382025-01-09T01:38:56.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63392025-01-09T01:38:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63402025-01-09T01:38:56.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63412025-01-09T01:38:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63422025-01-09T01:38:56.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63432025-01-09T01:38:56.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63442025-01-09T01:38:56.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63452025-01-09T01:38:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
63462025-01-09T01:38:56.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63472025-01-09T01:38:56.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63482025-01-09T01:38:56.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
63492025-01-09T01:38:56.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.957913ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
63502025-01-09T01:38:56.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63512025-01-09T01:38:56.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63522025-01-09T01:38:56.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.116039ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63532025-01-09T01:38:57.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69116bf1-186c-4220-bdc5-1ee8c98e9d42 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63542025-01-09T01:38:57.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69116bf1-186c-4220-bdc5-1ee8c98e9d42 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63552025-01-09T01:38:57.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69116bf1-186c-4220-bdc5-1ee8c98e9d42 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63562025-01-09T01:38:58.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd2c2313-4716-454e-b6e1-1d26d96f7c96 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63572025-01-09T01:38:58.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd2c2313-4716-454e-b6e1-1d26d96f7c96 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63582025-01-09T01:38:58.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dd2c2313-4716-454e-b6e1-1d26d96f7c96 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63592025-01-09T01:38:59.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = ef7919cf-d303-4847-a266-88481d1fff9d response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
63602025-01-09T01:38:59.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 220110d2-86a2-40db-9a49-79bb9f75f680 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63612025-01-09T01:38:59.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 220110d2-86a2-40db-9a49-79bb9f75f680 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63622025-01-09T01:38:59.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 220110d2-86a2-40db-9a49-79bb9f75f680 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63632025-01-09T01:39:00.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 341267db-d790-4187-a47b-92d360fcc30b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63642025-01-09T01:39:00.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 341267db-d790-4187-a47b-92d360fcc30b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63652025-01-09T01:39:00.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 341267db-d790-4187-a47b-92d360fcc30b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63662025-01-09T01:39:01.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 61a231f5-08bc-4207-99e4-18baed97ba34 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63672025-01-09T01:39:01.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 61a231f5-08bc-4207-99e4-18baed97ba34 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63682025-01-09T01:39:01.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 61a231f5-08bc-4207-99e4-18baed97ba34 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63692025-01-09T01:39:02.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b65744e6-f7a1-4c55-a16e-11ef5770a8e4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63702025-01-09T01:39:02.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b65744e6-f7a1-4c55-a16e-11ef5770a8e4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63712025-01-09T01:39:02.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b65744e6-f7a1-4c55-a16e-11ef5770a8e4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63722025-01-09T01:39:03.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ca0d4868-6a6e-46cf-982c-0725d7a1c47a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63732025-01-09T01:39:03.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ca0d4868-6a6e-46cf-982c-0725d7a1c47a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63742025-01-09T01:39:03.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ca0d4868-6a6e-46cf-982c-0725d7a1c47a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63752025-01-09T01:39:04.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a496e0af-3c98-43d9-87f2-5896839ecfc6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63762025-01-09T01:39:04.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a496e0af-3c98-43d9-87f2-5896839ecfc6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63772025-01-09T01:39:04.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a496e0af-3c98-43d9-87f2-5896839ecfc6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63782025-01-09T01:39:05.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d22cb0a-317f-45eb-ab12-6703d8eca257 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63792025-01-09T01:39:05.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d22cb0a-317f-45eb-ab12-6703d8eca257 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63802025-01-09T01:39:05.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d22cb0a-317f-45eb-ab12-6703d8eca257 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
63812025-01-09T01:39:06.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
63822025-01-09T01:39:06.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63832025-01-09T01:39:06.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63842025-01-09T01:39:06.603ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
63852025-01-09T01:39:06.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63862025-01-09T01:39:06.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63872025-01-09T01:39:06.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882025-01-09T01:39:06.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63892025-01-09T01:39:06.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63902025-01-09T01:39:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63912025-01-09T01:39:06.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63922025-01-09T01:39:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63932025-01-09T01:39:06.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942025-01-09T01:39:06.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63952025-01-09T01:39:06.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63962025-01-09T01:39:06.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
63972025-01-09T01:39:06.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63982025-01-09T01:39:06.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63992025-01-09T01:39:06.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
64002025-01-09T01:39:06.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.600516ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
64012025-01-09T01:39:06.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.507381ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64022025-01-09T01:39:06.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b468a604-ef6e-49a0-b474-6987502c2a85 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64032025-01-09T01:39:06.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b468a604-ef6e-49a0-b474-6987502c2a85 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64042025-01-09T01:39:06.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b468a604-ef6e-49a0-b474-6987502c2a85 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64052025-01-09T01:39:07.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65ded147-a8d6-4582-81d9-efec48311ade roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64062025-01-09T01:39:07.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65ded147-a8d6-4582-81d9-efec48311ade resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64072025-01-09T01:39:07.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65ded147-a8d6-4582-81d9-efec48311ade response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64082025-01-09T01:39:08.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4df9d2de-56f4-4879-a8e3-234c233eb2c4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64092025-01-09T01:39:08.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4df9d2de-56f4-4879-a8e3-234c233eb2c4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64102025-01-09T01:39:08.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4df9d2de-56f4-4879-a8e3-234c233eb2c4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64112025-01-09T01:39:09.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 963 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = a0d6ac72-2c98-431c-a9e2-e92e646235a0 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
64122025-01-09T01:39:09.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 64cca657-e5ba-4f5d-b402-b73814c7f79f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64132025-01-09T01:39:09.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 64cca657-e5ba-4f5d-b402-b73814c7f79f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64142025-01-09T01:39:09.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 64cca657-e5ba-4f5d-b402-b73814c7f79f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64152025-01-09T01:39:10.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 97930e91-00a2-4e00-a218-316572663851 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64162025-01-09T01:39:10.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 97930e91-00a2-4e00-a218-316572663851 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64172025-01-09T01:39:10.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 97930e91-00a2-4e00-a218-316572663851 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64182025-01-09T01:39:11.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b2d1afb-839b-46c1-8549-22323f5b537d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64192025-01-09T01:39:11.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b2d1afb-839b-46c1-8549-22323f5b537d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64202025-01-09T01:39:11.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b2d1afb-839b-46c1-8549-22323f5b537d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64212025-01-09T01:39:12.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 359bd906-7a9b-423c-829d-55cf24908a0b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64222025-01-09T01:39:12.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 359bd906-7a9b-423c-829d-55cf24908a0b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64232025-01-09T01:39:12.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 359bd906-7a9b-423c-829d-55cf24908a0b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64242025-01-09T01:39:13.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3d46e376-addb-44bf-8d7f-53150650821d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64252025-01-09T01:39:13.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3d46e376-addb-44bf-8d7f-53150650821d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64262025-01-09T01:39:13.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3d46e376-addb-44bf-8d7f-53150650821d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64272025-01-09T01:39:14.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bfdc6288-bcc0-4d73-b629-95268825efc4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64282025-01-09T01:39:14.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bfdc6288-bcc0-4d73-b629-95268825efc4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64292025-01-09T01:39:14.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bfdc6288-bcc0-4d73-b629-95268825efc4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64302025-01-09T01:39:15.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40cc0392-99d5-46bf-b61e-2630acae7de6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64312025-01-09T01:39:15.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40cc0392-99d5-46bf-b61e-2630acae7de6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64322025-01-09T01:39:15.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40cc0392-99d5-46bf-b61e-2630acae7de6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
64332025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
64342025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64352025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
64362025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
64372025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64382025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
64392025-01-09T01:39:16.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64402025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64412025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64422025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64432025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
64442025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
64452025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64462025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
64472025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64482025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64492025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
64502025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64512025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
64522025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64532025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
64542025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
64552025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64562025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64572025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
64582025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64592025-01-09T01:39:16.604ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64602025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64612025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
64622025-01-09T01:39:16.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64632025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64642025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64652025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64662025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64672025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64682025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64692025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64702025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64712025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64722025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
64732025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64742025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
64752025-01-09T01:39:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64762025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64772025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64782025-01-09T01:39:16.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1289, tv_nsec: 7638724 } })
64792025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64802025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
64812025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64822025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
64832025-01-09T01:39:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64842025-01-09T01:39:16.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
64852025-01-09T01:39:16.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1289, tv_nsec: 8082281 } })
64862025-01-09T01:39:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64872025-01-09T01:39:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64882025-01-09T01:39:16.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892025-01-09T01:39:16.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
64902025-01-09T01:39:16.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64912025-01-09T01:39:16.608ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.34425ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64922025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64932025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64942025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64952025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64962025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64972025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64982025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64992025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65002025-01-09T01:39:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65012025-01-09T01:39:16.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65022025-01-09T01:39:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65032025-01-09T01:39:16.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65042025-01-09T01:39:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65052025-01-09T01:39:16.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65062025-01-09T01:39:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65072025-01-09T01:39:16.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65082025-01-09T01:39:16.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65092025-01-09T01:39:16.628ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1289, tv_nsec: 29295652 } })
65102025-01-09T01:39:16.628ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
65112025-01-09T01:39:16.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65122025-01-09T01:39:16.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65132025-01-09T01:39:16.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65142025-01-09T01:39:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65152025-01-09T01:39:16.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65162025-01-09T01:39:16.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65172025-01-09T01:39:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65182025-01-09T01:39:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65192025-01-09T01:39:16.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.346639ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
65202025-01-09T01:39:16.664ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65212025-01-09T01:39:16.664ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65222025-01-09T01:39:16.664ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65232025-01-09T01:39:16.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.867271ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
65242025-01-09T01:39:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65252025-01-09T01:39:16.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65262025-01-09T01:39:16.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65272025-01-09T01:39:16.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65282025-01-09T01:39:16.669ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65292025-01-09T01:39:16.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.465087ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65302025-01-09T01:39:16.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65312025-01-09T01:39:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65322025-01-09T01:39:16.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65332025-01-09T01:39:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65342025-01-09T01:39:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65352025-01-09T01:39:16.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65362025-01-09T01:39:16.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65372025-01-09T01:39:16.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65382025-01-09T01:39:16.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65392025-01-09T01:39:16.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65402025-01-09T01:39:16.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65412025-01-09T01:39:16.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65422025-01-09T01:39:16.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
65432025-01-09T01:39:16.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65442025-01-09T01:39:16.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65452025-01-09T01:39:16.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65462025-01-09T01:39:16.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65472025-01-09T01:39:16.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
65482025-01-09T01:39:16.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.722962ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
65492025-01-09T01:39:16.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502025-01-09T01:39:16.710ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65512025-01-09T01:39:16.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65522025-01-09T01:39:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65532025-01-09T01:39:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.016973ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65542025-01-09T01:39:16.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.56009ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65552025-01-09T01:39:16.717ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65562025-01-09T01:39:16.717ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65572025-01-09T01:39:16.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65582025-01-09T01:39:16.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65592025-01-09T01:39:16.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65602025-01-09T01:39:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65612025-01-09T01:39:16.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65622025-01-09T01:39:16.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65632025-01-09T01:39:16.723ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65642025-01-09T01:39:16.723ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65652025-01-09T01:39:16.723ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a28cdadc-72b8-4d30-9278-cb7869e1ece1", "content-length": "26", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
65662025-01-09T01:39:16.723ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65672025-01-09T01:39:16.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.674395ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
65682025-01-09T01:39:16.726ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65692025-01-09T01:39:16.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702025-01-09T01:39:16.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
65712025-01-09T01:39:16.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65722025-01-09T01:39:16.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65732025-01-09T01:39:16.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 135.967837ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65742025-01-09T01:39:16.741ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.084505ms iteration = 12 status = 0
65752025-01-09T01:39:16.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65762025-01-09T01:39:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65772025-01-09T01:39:16.778ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65782025-01-09T01:39:16.779ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65792025-01-09T01:39:16.779ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.201422ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65802025-01-09T01:39:16.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65812025-01-09T01:39:16.802ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65822025-01-09T01:39:16.802ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "318287b3-32d2-41cb-9f05-2ca0591fa179", "content-length": "26", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
65832025-01-09T01:39:16.802ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65842025-01-09T01:39:16.804ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65852025-01-09T01:39:16.822ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
65862025-01-09T01:39:16.822ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65872025-01-09T01:39:16.822ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ad53012-eae3-484d-a984-f71bbd9a87c8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
65882025-01-09T01:39:16.822ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65892025-01-09T01:39:16.824ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
65902025-01-09T01:39:16.825ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.870363ms iteration = 14 status = {"physical_disks_added":0}
65912025-01-09T01:39:16.835ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65922025-01-09T01:39:16.835ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "799ae288-7c8a-4490-a9ed-f0489d5cdbfd", "content-length": "1", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
65932025-01-09T01:39:16.837ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65942025-01-09T01:39:16.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65952025-01-09T01:39:16.871ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65962025-01-09T01:39:16.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65972025-01-09T01:39:16.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3909ad9-4a3a-49c6-8646-93011aab6573", "content-length": "372", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
65982025-01-09T01:39:16.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65992025-01-09T01:39:16.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66002025-01-09T01:39:16.873ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 270.010873ms iteration = 12 status = null
66012025-01-09T01:39:16.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66022025-01-09T01:39:16.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66032025-01-09T01:39:16.886ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 282.361332ms iteration = 12 status = {}
66042025-01-09T01:39:16.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c492408c-b03b-437f-a55c-2286fc8423f1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66052025-01-09T01:39:16.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c492408c-b03b-437f-a55c-2286fc8423f1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66062025-01-09T01:39:16.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66072025-01-09T01:39:16.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c492408c-b03b-437f-a55c-2286fc8423f1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66082025-01-09T01:39:16.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66092025-01-09T01:39:16.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66102025-01-09T01:39:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66112025-01-09T01:39:16.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66122025-01-09T01:39:16.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66132025-01-09T01:39:16.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66142025-01-09T01:39:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66152025-01-09T01:39:16.926ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66162025-01-09T01:39:16.926ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66172025-01-09T01:39:16.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "69581a56-6676-4d38-b951-e2d45aa4c530", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
66182025-01-09T01:39:16.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66192025-01-09T01:39:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66202025-01-09T01:39:16.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66212025-01-09T01:39:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66222025-01-09T01:39:16.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66232025-01-09T01:39:16.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66242025-01-09T01:39:17.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66252025-01-09T01:39:17.009ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66262025-01-09T01:39:17.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66272025-01-09T01:39:17.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66282025-01-09T01:39:17.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66292025-01-09T01:39:17.016ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
66302025-01-09T01:39:17.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66312025-01-09T01:39:17.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66322025-01-09T01:39:17.026ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66332025-01-09T01:39:17.027ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c559f652-e9cb-4ea3-93eb-8ad34b929ed7", "content-length": "134", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
66342025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66352025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
66362025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66372025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66382025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66392025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66402025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66412025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66422025-01-09T01:39:17.027ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66432025-01-09T01:39:17.028ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66442025-01-09T01:39:17.028ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
66452025-01-09T01:39:17.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66462025-01-09T01:39:17.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66472025-01-09T01:39:17.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66482025-01-09T01:39:17.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "66048d55-6911-4ac0-a3c3-40ee164357c1", "content-length": "2", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
66492025-01-09T01:39:17.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66502025-01-09T01:39:17.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "beb3817b-2082-480b-b416-9545a2bf2a95", "content-length": "52", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
66512025-01-09T01:39:17.031ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
66522025-01-09T01:39:17.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66532025-01-09T01:39:17.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a72357dd-d27f-4f80-8741-d4c1148b3785", "date": "Thu, 09 Jan 2025 01:39:17 GMT"} })
66542025-01-09T01:39:17.074ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 469.501823ms iteration = 12 status = {}
66552025-01-09T01:39:17.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5508e7b-8497-4d75-8bda-e01b3943cbb3", "content-length": "691", "date": "Thu, 09 Jan 2025 01:39:17 GMT"} })
66562025-01-09T01:39:17.077ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66572025-01-09T01:39:17.077ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66582025-01-09T01:39:17.077ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66592025-01-09T01:39:17.079ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.823588ms iteration = 12 status = {}
66602025-01-09T01:39:17.173ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "612cc05f-b179-4aaa-94cf-c21027a1eecb", "date": "Thu, 09 Jan 2025 01:39:17 GMT"} })
66612025-01-09T01:39:17.173ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
66622025-01-09T01:39:17.173ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66632025-01-09T01:39:17.173ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "425d7bb1-54f9-4e1f-aa1f-072402b17471", "content-length": "682", "date": "Thu, 09 Jan 2025 01:39:16 GMT"} })
66642025-01-09T01:39:17.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66652025-01-09T01:39:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66662025-01-09T01:39:17.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66672025-01-09T01:39:17.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66682025-01-09T01:39:17.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66692025-01-09T01:39:17.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66702025-01-09T01:39:17.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66712025-01-09T01:39:17.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66722025-01-09T01:39:17.190ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 585.412827ms iteration = 12 status = {}
66732025-01-09T01:39:17.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0b19c7e-fc7e-4e40-8fbf-dc9307fd5ca6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66742025-01-09T01:39:17.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0b19c7e-fc7e-4e40-8fbf-dc9307fd5ca6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66752025-01-09T01:39:17.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0b19c7e-fc7e-4e40-8fbf-dc9307fd5ca6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66762025-01-09T01:39:17.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 46f42a81-bb3d-480d-9fe0-93b40ccd4cd4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
66772025-01-09T01:39:17.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 46f42a81-bb3d-480d-9fe0-93b40ccd4cd4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
66782025-01-09T01:39:17.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 46f42a81-bb3d-480d-9fe0-93b40ccd4cd4 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
66792025-01-09T01:39:18.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b756777-6f3a-4949-9410-47841e553054 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66802025-01-09T01:39:18.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b756777-6f3a-4949-9410-47841e553054 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66812025-01-09T01:39:18.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b756777-6f3a-4949-9410-47841e553054 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66822025-01-09T01:39:19.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = e2689583-91b6-454b-91eb-12a88b9b1863 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
66832025-01-09T01:39:19.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f18715b8-58d3-4199-a1ed-4e96712ca03e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66842025-01-09T01:39:19.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f18715b8-58d3-4199-a1ed-4e96712ca03e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66852025-01-09T01:39:19.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f18715b8-58d3-4199-a1ed-4e96712ca03e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66862025-01-09T01:39:21.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bc907689-7bfe-4406-a3a3-ef193fcc8289 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66872025-01-09T01:39:21.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bc907689-7bfe-4406-a3a3-ef193fcc8289 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66882025-01-09T01:39:21.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bc907689-7bfe-4406-a3a3-ef193fcc8289 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66892025-01-09T01:39:22.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2774df10-2f12-4955-959f-d905e395d050 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66902025-01-09T01:39:22.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2774df10-2f12-4955-959f-d905e395d050 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66912025-01-09T01:39:22.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2774df10-2f12-4955-959f-d905e395d050 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66922025-01-09T01:39:23.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f1129be7-e210-4fab-9613-4be2c119a823 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66932025-01-09T01:39:23.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f1129be7-e210-4fab-9613-4be2c119a823 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66942025-01-09T01:39:23.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f1129be7-e210-4fab-9613-4be2c119a823 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66952025-01-09T01:39:24.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6450114c-8692-4881-b12b-741faaf33bbe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66962025-01-09T01:39:24.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6450114c-8692-4881-b12b-741faaf33bbe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66972025-01-09T01:39:24.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6450114c-8692-4881-b12b-741faaf33bbe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66982025-01-09T01:39:25.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f39d9624-0733-47fa-82cd-d9996bb6ac5a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
66992025-01-09T01:39:25.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f39d9624-0733-47fa-82cd-d9996bb6ac5a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67002025-01-09T01:39:25.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f39d9624-0733-47fa-82cd-d9996bb6ac5a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67012025-01-09T01:39:26.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8349e81a-2c0c-44a4-a6d0-9f1f7880469b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67022025-01-09T01:39:26.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8349e81a-2c0c-44a4-a6d0-9f1f7880469b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67032025-01-09T01:39:26.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8349e81a-2c0c-44a4-a6d0-9f1f7880469b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67042025-01-09T01:39:26.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
67052025-01-09T01:39:26.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67062025-01-09T01:39:26.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67072025-01-09T01:39:26.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
67082025-01-09T01:39:26.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67092025-01-09T01:39:26.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67102025-01-09T01:39:26.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67112025-01-09T01:39:26.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67122025-01-09T01:39:26.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67132025-01-09T01:39:26.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67142025-01-09T01:39:26.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67152025-01-09T01:39:26.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67162025-01-09T01:39:26.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67172025-01-09T01:39:26.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67182025-01-09T01:39:26.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.762954ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67192025-01-09T01:39:26.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67202025-01-09T01:39:26.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
67212025-01-09T01:39:26.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67222025-01-09T01:39:26.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67232025-01-09T01:39:26.686ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
67242025-01-09T01:39:26.686ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.31419ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
67252025-01-09T01:39:27.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9688528-4774-4fa8-8f64-d5b8d7457fb1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67262025-01-09T01:39:27.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9688528-4774-4fa8-8f64-d5b8d7457fb1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67272025-01-09T01:39:27.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9688528-4774-4fa8-8f64-d5b8d7457fb1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67282025-01-09T01:39:28.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4c0b999d-6d62-4120-8b67-5e1d49355743 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67292025-01-09T01:39:28.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4c0b999d-6d62-4120-8b67-5e1d49355743 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67302025-01-09T01:39:28.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4c0b999d-6d62-4120-8b67-5e1d49355743 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67312025-01-09T01:39:29.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b62b1545-b357-4701-8e3e-426e031372ac roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67322025-01-09T01:39:29.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b62b1545-b357-4701-8e3e-426e031372ac resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67332025-01-09T01:39:29.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b62b1545-b357-4701-8e3e-426e031372ac response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67342025-01-09T01:39:29.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 41575159-d445-4472-95f3-7931a7d0ff03 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
67352025-01-09T01:39:30.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47eddc70-73b0-4ea4-a3cc-ae71ff07f3e0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67362025-01-09T01:39:30.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47eddc70-73b0-4ea4-a3cc-ae71ff07f3e0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67372025-01-09T01:39:30.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47eddc70-73b0-4ea4-a3cc-ae71ff07f3e0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67382025-01-09T01:39:31.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9242ae87-add5-4581-9919-a9ece48bba1f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67392025-01-09T01:39:31.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9242ae87-add5-4581-9919-a9ece48bba1f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67402025-01-09T01:39:31.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9242ae87-add5-4581-9919-a9ece48bba1f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67412025-01-09T01:39:32.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f0bfa94-b7e2-49d3-bede-7ba5b6ee9388 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67422025-01-09T01:39:32.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f0bfa94-b7e2-49d3-bede-7ba5b6ee9388 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67432025-01-09T01:39:32.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f0bfa94-b7e2-49d3-bede-7ba5b6ee9388 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67442025-01-09T01:39:33.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7aa268f9-6903-4bd7-9285-768cb58bfe72 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67452025-01-09T01:39:33.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7aa268f9-6903-4bd7-9285-768cb58bfe72 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67462025-01-09T01:39:33.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7aa268f9-6903-4bd7-9285-768cb58bfe72 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67472025-01-09T01:39:34.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59b2ab01-9438-4175-b160-5e908951bbe9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67482025-01-09T01:39:34.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59b2ab01-9438-4175-b160-5e908951bbe9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67492025-01-09T01:39:34.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59b2ab01-9438-4175-b160-5e908951bbe9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67502025-01-09T01:39:35.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2516e33-1ce9-4cb1-b21e-42026f9d446d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67512025-01-09T01:39:35.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2516e33-1ce9-4cb1-b21e-42026f9d446d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67522025-01-09T01:39:35.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2516e33-1ce9-4cb1-b21e-42026f9d446d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67532025-01-09T01:39:36.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b01fb336-62b0-4162-8110-30993719a4bd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67542025-01-09T01:39:36.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b01fb336-62b0-4162-8110-30993719a4bd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67552025-01-09T01:39:36.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b01fb336-62b0-4162-8110-30993719a4bd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67562025-01-09T01:39:36.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
67572025-01-09T01:39:36.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67582025-01-09T01:39:36.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67592025-01-09T01:39:36.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
67602025-01-09T01:39:36.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67612025-01-09T01:39:36.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67622025-01-09T01:39:36.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67632025-01-09T01:39:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67642025-01-09T01:39:36.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.968504ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67652025-01-09T01:39:36.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67662025-01-09T01:39:36.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67672025-01-09T01:39:36.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67682025-01-09T01:39:36.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67692025-01-09T01:39:36.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67702025-01-09T01:39:36.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67712025-01-09T01:39:36.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67722025-01-09T01:39:36.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
67732025-01-09T01:39:36.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67742025-01-09T01:39:36.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67752025-01-09T01:39:36.659ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
67762025-01-09T01:39:36.659ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.047531ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
67772025-01-09T01:39:37.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8efdd946-78ee-46e1-ac0a-540360b0eed4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67782025-01-09T01:39:37.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8efdd946-78ee-46e1-ac0a-540360b0eed4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67792025-01-09T01:39:37.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8efdd946-78ee-46e1-ac0a-540360b0eed4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67802025-01-09T01:39:38.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 929ce65d-d13b-4c39-8dea-eeeeb8d45c46 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67812025-01-09T01:39:38.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 929ce65d-d13b-4c39-8dea-eeeeb8d45c46 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67822025-01-09T01:39:38.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 929ce65d-d13b-4c39-8dea-eeeeb8d45c46 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67832025-01-09T01:39:39.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 912 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = b7c81940-4390-41b5-b658-92fc034c9bcf response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
67842025-01-09T01:39:39.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4da577b6-0f42-468f-84a8-19df8f338601 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67852025-01-09T01:39:39.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4da577b6-0f42-468f-84a8-19df8f338601 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67862025-01-09T01:39:39.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4da577b6-0f42-468f-84a8-19df8f338601 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67872025-01-09T01:39:40.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c7dc920c-1c27-4aa6-b9a5-f205d08fc142 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67882025-01-09T01:39:40.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c7dc920c-1c27-4aa6-b9a5-f205d08fc142 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67892025-01-09T01:39:40.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c7dc920c-1c27-4aa6-b9a5-f205d08fc142 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67902025-01-09T01:39:41.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06e7ac93-0acd-40b0-9d82-368a9fd52e17 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67912025-01-09T01:39:41.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06e7ac93-0acd-40b0-9d82-368a9fd52e17 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67922025-01-09T01:39:41.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06e7ac93-0acd-40b0-9d82-368a9fd52e17 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67932025-01-09T01:39:42.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab636e2c-2eca-4660-a1cf-0e0eec6c34c5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67942025-01-09T01:39:42.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab636e2c-2eca-4660-a1cf-0e0eec6c34c5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67952025-01-09T01:39:42.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab636e2c-2eca-4660-a1cf-0e0eec6c34c5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67962025-01-09T01:39:43.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 674267eb-ebac-4b80-b4ab-ae5a6cfd3894 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67972025-01-09T01:39:43.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 674267eb-ebac-4b80-b4ab-ae5a6cfd3894 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67982025-01-09T01:39:43.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 674267eb-ebac-4b80-b4ab-ae5a6cfd3894 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
67992025-01-09T01:39:44.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0212e0a4-de1a-4df7-bf09-9ef763298076 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68002025-01-09T01:39:44.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0212e0a4-de1a-4df7-bf09-9ef763298076 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68012025-01-09T01:39:44.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0212e0a4-de1a-4df7-bf09-9ef763298076 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68022025-01-09T01:39:45.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1daffa71-3d27-4cf3-a4cd-a7d41c8ec1f5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68032025-01-09T01:39:45.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1daffa71-3d27-4cf3-a4cd-a7d41c8ec1f5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68042025-01-09T01:39:45.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1daffa71-3d27-4cf3-a4cd-a7d41c8ec1f5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68052025-01-09T01:39:46.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5883d122-7b76-4ddc-9329-0b91826f24a2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68062025-01-09T01:39:46.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5883d122-7b76-4ddc-9329-0b91826f24a2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68072025-01-09T01:39:46.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5883d122-7b76-4ddc-9329-0b91826f24a2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
68082025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
68092025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
68102025-01-09T01:39:46.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
68112025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
68122025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68132025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.881\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
68142025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68152025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
68162025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
68172025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68182025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
68192025-01-09T01:39:46.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:29:46.603794853 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68202025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
68212025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68222025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68232025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
68242025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
68252025-01-09T01:39:46.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68262025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
68272025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
68282025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68292025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68302025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
68312025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68322025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
68332025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68342025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68352025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68362025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68372025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68382025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68392025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68402025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
68412025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
68422025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68432025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68442025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
68452025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
68462025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68472025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
68482025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68492025-01-09T01:39:46.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68502025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68512025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68522025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
68532025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68542025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
68552025-01-09T01:39:46.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 5399708 } })
68562025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68572025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
68582025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
68592025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68602025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68612025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
68622025-01-09T01:39:46.604ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68632025-01-09T01:39:46.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 5440118 } })
68642025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68652025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
68662025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68672025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
68682025-01-09T01:39:46.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68692025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68702025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68712025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68722025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68732025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68742025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68752025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68762025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68772025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
68782025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.345951ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
68792025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68802025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68812025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68822025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68832025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
68842025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.424123ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
68852025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68862025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68872025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68882025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68892025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68902025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68912025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68922025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68932025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68942025-01-09T01:39:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68952025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68962025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68972025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
68982025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68992025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
69002025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69012025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
69022025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69032025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
69042025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69052025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69062025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69072025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69082025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69092025-01-09T01:39:46.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69102025-01-09T01:39:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.046855ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69112025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
69122025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
69132025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69142025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69152025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69162025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69172025-01-09T01:39:46.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 9202339 } })
69182025-01-09T01:39:46.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:29:46.603794853 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69192025-01-09T01:39:46.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.823448ms iteration = 7 status = {"expiration":"2025-01-09T01:29:46.603794853Z","pruned":[]}
69202025-01-09T01:39:46.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69212025-01-09T01:39:46.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 9721167 } })
69222025-01-09T01:39:46.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
69232025-01-09T01:39:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69242025-01-09T01:39:46.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69252025-01-09T01:39:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69262025-01-09T01:39:46.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69272025-01-09T01:39:46.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282025-01-09T01:39:46.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292025-01-09T01:39:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69302025-01-09T01:39:46.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69312025-01-09T01:39:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69322025-01-09T01:39:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69332025-01-09T01:39:46.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69342025-01-09T01:39:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69352025-01-09T01:39:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69362025-01-09T01:39:46.616ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69372025-01-09T01:39:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69382025-01-09T01:39:46.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69392025-01-09T01:39:46.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69402025-01-09T01:39:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69412025-01-09T01:39:46.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69422025-01-09T01:39:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69432025-01-09T01:39:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69442025-01-09T01:39:46.633ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.601824ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
69452025-01-09T01:39:46.646ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69462025-01-09T01:39:46.646ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69472025-01-09T01:39:46.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69482025-01-09T01:39:46.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69492025-01-09T01:39:46.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69502025-01-09T01:39:46.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69512025-01-09T01:39:46.656ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69522025-01-09T01:39:46.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532025-01-09T01:39:46.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69542025-01-09T01:39:46.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69552025-01-09T01:39:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69562025-01-09T01:39:46.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69572025-01-09T01:39:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69582025-01-09T01:39:46.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69592025-01-09T01:39:46.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69602025-01-09T01:39:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69612025-01-09T01:39:46.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69622025-01-09T01:39:46.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69632025-01-09T01:39:46.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69642025-01-09T01:39:46.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69652025-01-09T01:39:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69662025-01-09T01:39:46.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69672025-01-09T01:39:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69682025-01-09T01:39:46.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69692025-01-09T01:39:46.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69702025-01-09T01:39:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69712025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69722025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69732025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69742025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69752025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69762025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69772025-01-09T01:39:46.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69782025-01-09T01:39:46.674ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1319, tv_nsec: 75089449 } })
69792025-01-09T01:39:46.674ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
69802025-01-09T01:39:46.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69812025-01-09T01:39:46.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.001199ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69822025-01-09T01:39:46.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69832025-01-09T01:39:46.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69842025-01-09T01:39:46.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69852025-01-09T01:39:46.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69862025-01-09T01:39:46.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69872025-01-09T01:39:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69882025-01-09T01:39:46.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69892025-01-09T01:39:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69902025-01-09T01:39:46.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69912025-01-09T01:39:46.680ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922025-01-09T01:39:46.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69932025-01-09T01:39:46.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69942025-01-09T01:39:46.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69952025-01-09T01:39:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
69962025-01-09T01:39:46.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69972025-01-09T01:39:46.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69982025-01-09T01:39:46.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69992025-01-09T01:39:46.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70002025-01-09T01:39:46.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70012025-01-09T01:39:46.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.371241ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70022025-01-09T01:39:46.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70032025-01-09T01:39:46.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70042025-01-09T01:39:46.689ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70052025-01-09T01:39:46.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.88673ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
70062025-01-09T01:39:46.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70072025-01-09T01:39:46.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70082025-01-09T01:39:46.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.518508ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
70092025-01-09T01:39:46.690ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70102025-01-09T01:39:46.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70112025-01-09T01:39:46.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70122025-01-09T01:39:46.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70132025-01-09T01:39:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70142025-01-09T01:39:46.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70152025-01-09T01:39:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70162025-01-09T01:39:46.694ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70172025-01-09T01:39:46.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70182025-01-09T01:39:46.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70192025-01-09T01:39:46.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70202025-01-09T01:39:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70212025-01-09T01:39:46.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70222025-01-09T01:39:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70232025-01-09T01:39:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70242025-01-09T01:39:46.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.040973ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70252025-01-09T01:39:46.702ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70262025-01-09T01:39:46.702ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70272025-01-09T01:39:46.702ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 96.34332ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70282025-01-09T01:39:46.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70292025-01-09T01:39:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70302025-01-09T01:39:46.709ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 104.41014ms iteration = 4 status = {"nsuccess":5}
70312025-01-09T01:39:46.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70322025-01-09T01:39:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70332025-01-09T01:39:46.728ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
70342025-01-09T01:39:46.728ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.161393ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
70352025-01-09T01:39:46.732ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70362025-01-09T01:39:46.733ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70372025-01-09T01:39:46.733ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70382025-01-09T01:39:46.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70392025-01-09T01:39:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70402025-01-09T01:39:46.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70412025-01-09T01:39:46.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70422025-01-09T01:39:46.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70432025-01-09T01:39:46.736ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70442025-01-09T01:39:46.736ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
70452025-01-09T01:39:46.736ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.252638ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70462025-01-09T01:39:46.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70472025-01-09T01:39:46.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70482025-01-09T01:39:46.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70492025-01-09T01:39:46.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70502025-01-09T01:39:46.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70512025-01-09T01:39:46.750ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
70522025-01-09T01:39:46.750ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70532025-01-09T01:39:46.750ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70542025-01-09T01:39:46.750ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "449d0be6-21b4-4c81-91e2-854cdfad4d03", "content-length": "26", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
70552025-01-09T01:39:46.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70562025-01-09T01:39:46.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70572025-01-09T01:39:46.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70582025-01-09T01:39:46.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70592025-01-09T01:39:46.769ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
70602025-01-09T01:39:46.769ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
70612025-01-09T01:39:46.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70622025-01-09T01:39:46.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70632025-01-09T01:39:46.770ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70642025-01-09T01:39:46.770ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70652025-01-09T01:39:46.770ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70662025-01-09T01:39:46.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70672025-01-09T01:39:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70682025-01-09T01:39:46.772ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70692025-01-09T01:39:46.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 167.937182ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70702025-01-09T01:39:46.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712025-01-09T01:39:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70722025-01-09T01:39:46.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70732025-01-09T01:39:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70742025-01-09T01:39:46.782ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
70752025-01-09T01:39:46.782ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
70762025-01-09T01:39:46.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70772025-01-09T01:39:46.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70782025-01-09T01:39:46.796ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70792025-01-09T01:39:46.796ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70802025-01-09T01:39:46.796ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 191.772255ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70812025-01-09T01:39:46.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70822025-01-09T01:39:46.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70832025-01-09T01:39:46.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70842025-01-09T01:39:46.802ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70852025-01-09T01:39:46.803ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6f42a8d-0b2f-4460-863f-f3f6900fefde", "content-length": "26", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
70862025-01-09T01:39:46.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70872025-01-09T01:39:46.805ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70882025-01-09T01:39:46.806ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
70892025-01-09T01:39:46.806ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70902025-01-09T01:39:46.806ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e41149d-dbba-4182-90dc-920e4d3503a3", "content-length": "26", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
70912025-01-09T01:39:46.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70922025-01-09T01:39:46.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932025-01-09T01:39:46.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
70942025-01-09T01:39:46.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70952025-01-09T01:39:46.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70962025-01-09T01:39:46.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70972025-01-09T01:39:46.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 204.564091ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
70982025-01-09T01:39:46.815ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
70992025-01-09T01:39:46.815ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71002025-01-09T01:39:46.815ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
71012025-01-09T01:39:46.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 211.819188ms iteration = 7 status = {"generation":1}
71022025-01-09T01:39:46.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71032025-01-09T01:39:46.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
71042025-01-09T01:39:46.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71052025-01-09T01:39:46.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71062025-01-09T01:39:46.823ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 218.529736ms iteration = 13 status = 0
71072025-01-09T01:39:46.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71082025-01-09T01:39:46.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71092025-01-09T01:39:46.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102025-01-09T01:39:46.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71112025-01-09T01:39:46.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71122025-01-09T01:39:46.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71132025-01-09T01:39:46.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71142025-01-09T01:39:46.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71152025-01-09T01:39:46.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71162025-01-09T01:39:46.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71172025-01-09T01:39:46.845ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
71182025-01-09T01:39:46.845ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71192025-01-09T01:39:46.845ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
71202025-01-09T01:39:46.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 241.718599ms iteration = 7 status = {"generation":2}
71212025-01-09T01:39:46.862ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71222025-01-09T01:39:46.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 258.026491ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71232025-01-09T01:39:46.865ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 260.694354ms iteration = 15 status = {"physical_disks_added":0}
71242025-01-09T01:39:46.890ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
71252025-01-09T01:39:46.890ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 286.54251ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71262025-01-09T01:39:46.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71272025-01-09T01:39:46.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71282025-01-09T01:39:46.924ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71292025-01-09T01:39:46.931ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71302025-01-09T01:39:46.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c655318f-7f2e-4389-9b0d-c32c7629ebfe", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71312025-01-09T01:39:46.932ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71322025-01-09T01:39:46.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "46dca982-5637-4dee-b55f-b5870ac2aa39", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71332025-01-09T01:39:46.934ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71342025-01-09T01:39:46.936ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71352025-01-09T01:39:46.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.972276ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71362025-01-09T01:39:47.006ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 402.633097ms iteration = 13 status = {}
71372025-01-09T01:39:47.020ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71382025-01-09T01:39:47.020ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71392025-01-09T01:39:47.020ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "96d40f60-c2e8-4f77-baea-91a25368ea6b", "content-length": "372", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
71402025-01-09T01:39:47.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71412025-01-09T01:39:47.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71422025-01-09T01:39:47.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71432025-01-09T01:39:47.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71442025-01-09T01:39:47.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71452025-01-09T01:39:47.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71462025-01-09T01:39:47.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472025-01-09T01:39:47.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71482025-01-09T01:39:47.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71492025-01-09T01:39:47.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71502025-01-09T01:39:47.033ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71512025-01-09T01:39:47.033ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "058f6185-b9a7-41d4-90cc-c7f83b7399be", "content-length": "1", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
71522025-01-09T01:39:47.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71532025-01-09T01:39:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71542025-01-09T01:39:47.037ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 433.587545ms iteration = 13 status = null
71552025-01-09T01:39:47.050ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71562025-01-09T01:39:47.051ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6b5eb16c-c2da-45ae-a3dd-4eaf5d8733ae", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71572025-01-09T01:39:47.051ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71582025-01-09T01:39:47.053ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "86e45cb0-3f7f-4419-9a6a-5ffba924e483", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71592025-01-09T01:39:47.054ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71602025-01-09T01:39:47.055ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5ecf1513-8fd0-4dcb-9a55-a8e5ad7678ed", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71612025-01-09T01:39:47.055ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71622025-01-09T01:39:47.057ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71632025-01-09T01:39:47.057ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 454.222597ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71642025-01-09T01:39:47.074ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71652025-01-09T01:39:47.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71662025-01-09T01:39:47.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "419d56ad-d60e-409c-99f0-b58884e5461b", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
71672025-01-09T01:39:47.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71682025-01-09T01:39:47.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71692025-01-09T01:39:47.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71702025-01-09T01:39:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71712025-01-09T01:39:47.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71722025-01-09T01:39:47.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71732025-01-09T01:39:47.084ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71742025-01-09T01:39:47.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71752025-01-09T01:39:47.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "df3fc591-6cbd-4c32-ba0b-cd88989527d2", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
71762025-01-09T01:39:47.087ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 482.980779ms iteration = 13 status = {}
71772025-01-09T01:39:47.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71782025-01-09T01:39:47.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71792025-01-09T01:39:47.100ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
71802025-01-09T01:39:47.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71812025-01-09T01:39:47.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71822025-01-09T01:39:47.112ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71832025-01-09T01:39:47.113ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c861e88d-894f-4cb0-8ad3-95b3d1cac83f", "content-length": "134", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
71842025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71852025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
71862025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71872025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71882025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71892025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71902025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71912025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71922025-01-09T01:39:47.113ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71932025-01-09T01:39:47.114ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71942025-01-09T01:39:47.114ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
71952025-01-09T01:39:47.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71962025-01-09T01:39:47.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71972025-01-09T01:39:47.117ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71982025-01-09T01:39:47.117ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "17bff1fb-dc15-4fe3-b5b7-309ec4747183", "content-length": "2", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
71992025-01-09T01:39:47.117ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72002025-01-09T01:39:47.117ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "db695e80-1acc-4992-9aac-81e30ca630c0", "content-length": "52", "date": "Thu, 09 Jan 2025 01:39:46 GMT"} })
72012025-01-09T01:39:47.117ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
72022025-01-09T01:39:47.117ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72032025-01-09T01:39:47.149ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72042025-01-09T01:39:47.234ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72052025-01-09T01:39:47.234ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
72062025-01-09T01:39:47.272ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
72072025-01-09T01:39:47.272ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "068f2651-736d-4493-ae96-ea8231fc30ce", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
72082025-01-09T01:39:47.272ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
72092025-01-09T01:39:47.272ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65357
72102025-01-09T01:39:47.272ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72112025-01-09T01:39:47.272ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4b3457a-247f-4b56-b76b-f6524503c66d", "content-length": "691", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
72122025-01-09T01:39:47.273ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72132025-01-09T01:39:47.273ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72142025-01-09T01:39:47.273ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72152025-01-09T01:39:47.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65357 req_id = 608f259a-906f-4ab0-b890-b98796132f89 roles = RoleSet { roles: {} } uri = /metrics/producers
72162025-01-09T01:39:47.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65357 req_id = 608f259a-906f-4ab0-b890-b98796132f89 resource = Database result = Ok(()) uri = /metrics/producers
72172025-01-09T01:39:47.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "65446d62-3f19-4127-9307-8efb712e466e", "content-length": "682", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
72182025-01-09T01:39:47.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72192025-01-09T01:39:47.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72202025-01-09T01:39:47.277ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 672.776553ms iteration = 13 status = {}
72212025-01-09T01:39:47.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72222025-01-09T01:39:47.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72232025-01-09T01:39:47.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72242025-01-09T01:39:47.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72252025-01-09T01:39:47.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72262025-01-09T01:39:47.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72272025-01-09T01:39:47.296ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 691.90994ms iteration = 13 status = {}
72282025-01-09T01:39:47.332ZINFOnexus: assigned collector to new producer collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:76 producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
72292025-01-09T01:39:47.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59826 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65357 req_id = 608f259a-906f-4ab0-b890-b98796132f89 response_code = 201 uri = /metrics/producers
72302025-01-09T01:39:47.333ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "608f259a-906f-4ab0-b890-b98796132f89", "content-length": "41", "date": "Thu, 09 Jan 2025 01:39:47 GMT"} })
72312025-01-09T01:39:47.334ZDEBGnexus (producer-registration-task): registered with nexus successfully
72322025-01-09T01:39:47.334ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72332025-01-09T01:39:47.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c25bd694-8d08-47b1-a50a-cb266a01f011 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72342025-01-09T01:39:47.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c25bd694-8d08-47b1-a50a-cb266a01f011 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72352025-01-09T01:39:47.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c25bd694-8d08-47b1-a50a-cb266a01f011 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72362025-01-09T01:39:47.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c58f35f2-b0f0-48de-8d82-216eb903d061 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
72372025-01-09T01:39:47.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c58f35f2-b0f0-48de-8d82-216eb903d061 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
72382025-01-09T01:39:47.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c58f35f2-b0f0-48de-8d82-216eb903d061 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
72392025-01-09T01:39:48.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1339b132-8e69-4a4a-912d-069e400d576d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72402025-01-09T01:39:48.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1339b132-8e69-4a4a-912d-069e400d576d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72412025-01-09T01:39:48.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1339b132-8e69-4a4a-912d-069e400d576d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72422025-01-09T01:39:49.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 877fcc02-d2fa-4a52-99a6-bdd491933b23 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
72432025-01-09T01:39:49.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 31973c6e-fe4a-46b1-8e29-cea76877d408 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72442025-01-09T01:39:49.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 31973c6e-fe4a-46b1-8e29-cea76877d408 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72452025-01-09T01:39:49.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 31973c6e-fe4a-46b1-8e29-cea76877d408 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72462025-01-09T01:39:50.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f02e0a-1b69-4205-a271-e5fca0046e8c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72472025-01-09T01:39:50.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f02e0a-1b69-4205-a271-e5fca0046e8c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72482025-01-09T01:39:50.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f02e0a-1b69-4205-a271-e5fca0046e8c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72492025-01-09T01:39:51.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b4a1b84e-20a7-4484-a404-9a6dc6a95c5e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72502025-01-09T01:39:51.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b4a1b84e-20a7-4484-a404-9a6dc6a95c5e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72512025-01-09T01:39:51.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b4a1b84e-20a7-4484-a404-9a6dc6a95c5e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72522025-01-09T01:39:52.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb75a7f4-4667-40cc-89a3-00cff5be77b5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72532025-01-09T01:39:52.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb75a7f4-4667-40cc-89a3-00cff5be77b5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72542025-01-09T01:39:52.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb75a7f4-4667-40cc-89a3-00cff5be77b5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72552025-01-09T01:39:53.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4791af58-88fc-49d4-8147-10bedb213e8b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72562025-01-09T01:39:53.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4791af58-88fc-49d4-8147-10bedb213e8b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72572025-01-09T01:39:53.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4791af58-88fc-49d4-8147-10bedb213e8b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72582025-01-09T01:39:54.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 03b64469-446a-499d-aedd-838abb75bb1c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72592025-01-09T01:39:54.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 03b64469-446a-499d-aedd-838abb75bb1c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72602025-01-09T01:39:54.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 03b64469-446a-499d-aedd-838abb75bb1c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72612025-01-09T01:39:55.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bb288080-6e8b-43fc-a2ba-f4f44ba18bfc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72622025-01-09T01:39:55.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bb288080-6e8b-43fc-a2ba-f4f44ba18bfc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72632025-01-09T01:39:55.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bb288080-6e8b-43fc-a2ba-f4f44ba18bfc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72642025-01-09T01:39:56.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
72652025-01-09T01:39:56.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72662025-01-09T01:39:56.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72672025-01-09T01:39:56.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
72682025-01-09T01:39:56.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72692025-01-09T01:39:56.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72702025-01-09T01:39:56.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72712025-01-09T01:39:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72722025-01-09T01:39:56.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72732025-01-09T01:39:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72742025-01-09T01:39:56.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72752025-01-09T01:39:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72762025-01-09T01:39:56.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772025-01-09T01:39:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
72782025-01-09T01:39:56.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72792025-01-09T01:39:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72802025-01-09T01:39:56.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
72812025-01-09T01:39:56.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.01487ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
72822025-01-09T01:39:56.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72832025-01-09T01:39:56.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72842025-01-09T01:39:56.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.101741ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72852025-01-09T01:39:56.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 201adfaa-03eb-4d82-a684-be709d8bd8ce roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72862025-01-09T01:39:56.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 201adfaa-03eb-4d82-a684-be709d8bd8ce resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72872025-01-09T01:39:56.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 201adfaa-03eb-4d82-a684-be709d8bd8ce response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72882025-01-09T01:39:57.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b0aeb6b-2794-4177-9dc2-f75fb74da759 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72892025-01-09T01:39:57.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b0aeb6b-2794-4177-9dc2-f75fb74da759 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72902025-01-09T01:39:57.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b0aeb6b-2794-4177-9dc2-f75fb74da759 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72912025-01-09T01:39:58.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4bfb59c4-d32a-4b1c-9147-dcdfb9c5be7a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72922025-01-09T01:39:58.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4bfb59c4-d32a-4b1c-9147-dcdfb9c5be7a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72932025-01-09T01:39:58.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4bfb59c4-d32a-4b1c-9147-dcdfb9c5be7a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
72942025-01-09T01:39:59.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1263b5e3-0a62-4157-808e-bb3d1e23f560 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
72952025-01-09T01:39:59.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1263b5e3-0a62-4157-808e-bb3d1e23f560 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
72962025-01-09T01:39:59.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 1263b5e3-0a62-4157-808e-bb3d1e23f560 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
72972025-01-09T01:39:59.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 4e046fcc-7b1f-47bf-a048-b2458324ee96 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
72982025-01-09T01:39:59.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 4e046fcc-7b1f-47bf-a048-b2458324ee96 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
72992025-01-09T01:39:59.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = 4e046fcc-7b1f-47bf-a048-b2458324ee96 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
73002025-01-09T01:39:59.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = b41bd5e7-5202-4430-868a-16f9cc0b2303 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
73012025-01-09T01:39:59.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5634ac27-0eb0-46a4-9bba-90e2aed92209 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73022025-01-09T01:39:59.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5634ac27-0eb0-46a4-9bba-90e2aed92209 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73032025-01-09T01:39:59.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5634ac27-0eb0-46a4-9bba-90e2aed92209 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73042025-01-09T01:40:00.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ba44fa5-8e3d-46ea-8aa5-2c4f8f754abb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73052025-01-09T01:40:00.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ba44fa5-8e3d-46ea-8aa5-2c4f8f754abb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73062025-01-09T01:40:00.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ba44fa5-8e3d-46ea-8aa5-2c4f8f754abb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73072025-01-09T01:40:01.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a33b52ec-c3e8-4401-a905-9da639422681 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73082025-01-09T01:40:01.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a33b52ec-c3e8-4401-a905-9da639422681 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73092025-01-09T01:40:01.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a33b52ec-c3e8-4401-a905-9da639422681 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73102025-01-09T01:40:02.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ddd9269a-0a93-4b41-9455-fca400c732af roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73112025-01-09T01:40:02.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ddd9269a-0a93-4b41-9455-fca400c732af resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73122025-01-09T01:40:02.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ddd9269a-0a93-4b41-9455-fca400c732af response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73132025-01-09T01:40:03.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 240405aa-82a4-4b93-b61e-70cc8c3aeec9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73142025-01-09T01:40:03.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 240405aa-82a4-4b93-b61e-70cc8c3aeec9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73152025-01-09T01:40:03.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 240405aa-82a4-4b93-b61e-70cc8c3aeec9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73162025-01-09T01:40:04.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e278ace-0211-4d90-9b2b-326c857c9dbb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73172025-01-09T01:40:04.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e278ace-0211-4d90-9b2b-326c857c9dbb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73182025-01-09T01:40:04.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e278ace-0211-4d90-9b2b-326c857c9dbb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73192025-01-09T01:40:05.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e8664a8d-2aa4-4ad1-91d1-8ce42071eb55 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73202025-01-09T01:40:05.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e8664a8d-2aa4-4ad1-91d1-8ce42071eb55 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73212025-01-09T01:40:05.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e8664a8d-2aa4-4ad1-91d1-8ce42071eb55 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73222025-01-09T01:40:06.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
73232025-01-09T01:40:06.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73242025-01-09T01:40:06.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73252025-01-09T01:40:06.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
73262025-01-09T01:40:06.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73272025-01-09T01:40:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73282025-01-09T01:40:06.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292025-01-09T01:40:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73302025-01-09T01:40:06.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73312025-01-09T01:40:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73322025-01-09T01:40:06.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73332025-01-09T01:40:06.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73342025-01-09T01:40:06.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73352025-01-09T01:40:06.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
73362025-01-09T01:40:06.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73372025-01-09T01:40:06.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73382025-01-09T01:40:06.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
73392025-01-09T01:40:06.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.43238ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
73402025-01-09T01:40:06.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73412025-01-09T01:40:06.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73422025-01-09T01:40:06.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.459112ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73432025-01-09T01:40:06.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ac2c45a-fc19-4197-9bc2-a472b928f9f0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73442025-01-09T01:40:06.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ac2c45a-fc19-4197-9bc2-a472b928f9f0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73452025-01-09T01:40:06.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ac2c45a-fc19-4197-9bc2-a472b928f9f0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73462025-01-09T01:40:08.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 587e22fe-a72d-4066-b418-dee86ea97932 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73472025-01-09T01:40:08.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 587e22fe-a72d-4066-b418-dee86ea97932 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73482025-01-09T01:40:08.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 587e22fe-a72d-4066-b418-dee86ea97932 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73492025-01-09T01:40:09.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a96ff9b5-abc9-4bcf-85ea-4a68a23974e7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73502025-01-09T01:40:09.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a96ff9b5-abc9-4bcf-85ea-4a68a23974e7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73512025-01-09T01:40:09.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a96ff9b5-abc9-4bcf-85ea-4a68a23974e7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73522025-01-09T01:40:09.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = c3008651-9748-4cef-b8e3-c1ff7595095a response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
73532025-01-09T01:40:10.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4aa9ab05-89ea-40cf-9b61-a23ca316c638 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73542025-01-09T01:40:10.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4aa9ab05-89ea-40cf-9b61-a23ca316c638 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73552025-01-09T01:40:10.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4aa9ab05-89ea-40cf-9b61-a23ca316c638 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73562025-01-09T01:40:11.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c78fc25f-2836-48bf-ba1d-0c13bb02b03a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73572025-01-09T01:40:11.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c78fc25f-2836-48bf-ba1d-0c13bb02b03a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73582025-01-09T01:40:11.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c78fc25f-2836-48bf-ba1d-0c13bb02b03a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73592025-01-09T01:40:12.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6955911-405c-47f3-b994-5b1bf47175c8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73602025-01-09T01:40:12.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6955911-405c-47f3-b994-5b1bf47175c8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73612025-01-09T01:40:12.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6955911-405c-47f3-b994-5b1bf47175c8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73622025-01-09T01:40:13.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f53250f1-e24a-4980-b38c-0af34dbf9d05 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73632025-01-09T01:40:13.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f53250f1-e24a-4980-b38c-0af34dbf9d05 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73642025-01-09T01:40:13.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f53250f1-e24a-4980-b38c-0af34dbf9d05 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73652025-01-09T01:40:14.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 549c73d3-7267-4afb-84fb-f7fd9f2d672b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73662025-01-09T01:40:14.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 549c73d3-7267-4afb-84fb-f7fd9f2d672b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73672025-01-09T01:40:14.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 549c73d3-7267-4afb-84fb-f7fd9f2d672b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73682025-01-09T01:40:15.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f15a6f-a06c-4823-bf1e-b12ffe79a713 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73692025-01-09T01:40:15.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f15a6f-a06c-4823-bf1e-b12ffe79a713 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73702025-01-09T01:40:15.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f15a6f-a06c-4823-bf1e-b12ffe79a713 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73712025-01-09T01:40:16.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2ba72419-ede2-40f2-a1ba-b66633438602 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73722025-01-09T01:40:16.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2ba72419-ede2-40f2-a1ba-b66633438602 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73732025-01-09T01:40:16.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2ba72419-ede2-40f2-a1ba-b66633438602 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
73742025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
73752025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
73762025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73772025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73782025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
73792025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
73802025-01-09T01:40:16.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73812025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73822025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73832025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73842025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
73852025-01-09T01:40:16.604ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73862025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
73872025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73882025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
73892025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73902025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73912025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
73922025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
73932025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73942025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73952025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
73962025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73972025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73982025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
73992025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
74002025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74012025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74022025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
74032025-01-09T01:40:16.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74042025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74052025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74062025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74072025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74082025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74092025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74102025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74112025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74122025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74132025-01-09T01:40:16.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74142025-01-09T01:40:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
74152025-01-09T01:40:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
74162025-01-09T01:40:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74172025-01-09T01:40:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74182025-01-09T01:40:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74192025-01-09T01:40:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74202025-01-09T01:40:16.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1349, tv_nsec: 7360309 } })
74212025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74222025-01-09T01:40:16.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
74232025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.682589ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74242025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74252025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
74262025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
74272025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74282025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74292025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74302025-01-09T01:40:16.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1349, tv_nsec: 8088261 } })
74312025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74322025-01-09T01:40:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74332025-01-09T01:40:16.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
74342025-01-09T01:40:16.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74352025-01-09T01:40:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74362025-01-09T01:40:16.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74372025-01-09T01:40:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74382025-01-09T01:40:16.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74392025-01-09T01:40:16.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74402025-01-09T01:40:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74412025-01-09T01:40:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74422025-01-09T01:40:16.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74432025-01-09T01:40:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74442025-01-09T01:40:16.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74452025-01-09T01:40:16.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74462025-01-09T01:40:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74472025-01-09T01:40:16.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74482025-01-09T01:40:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74492025-01-09T01:40:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74502025-01-09T01:40:16.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74512025-01-09T01:40:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74522025-01-09T01:40:16.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74532025-01-09T01:40:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74542025-01-09T01:40:16.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74552025-01-09T01:40:16.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74562025-01-09T01:40:16.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74572025-01-09T01:40:16.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74582025-01-09T01:40:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74592025-01-09T01:40:16.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1349, tv_nsec: 23683992 } })
74602025-01-09T01:40:16.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
74612025-01-09T01:40:16.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74622025-01-09T01:40:16.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74632025-01-09T01:40:16.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
74642025-01-09T01:40:16.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74652025-01-09T01:40:16.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74662025-01-09T01:40:16.650ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
74672025-01-09T01:40:16.650ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.563758ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
74682025-01-09T01:40:16.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74692025-01-09T01:40:16.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.089459ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74702025-01-09T01:40:16.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74712025-01-09T01:40:16.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74722025-01-09T01:40:16.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74732025-01-09T01:40:16.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74742025-01-09T01:40:16.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74752025-01-09T01:40:16.663ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74762025-01-09T01:40:16.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.153896ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74772025-01-09T01:40:16.663ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74782025-01-09T01:40:16.663ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74792025-01-09T01:40:16.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74802025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74812025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.867931ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
74822025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74832025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.624939ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74842025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74852025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74862025-01-09T01:40:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74872025-01-09T01:40:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74882025-01-09T01:40:16.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.529327ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
74892025-01-09T01:40:16.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74902025-01-09T01:40:16.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74912025-01-09T01:40:16.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74922025-01-09T01:40:16.669ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74932025-01-09T01:40:16.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74942025-01-09T01:40:16.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74952025-01-09T01:40:16.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74962025-01-09T01:40:16.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74972025-01-09T01:40:16.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74982025-01-09T01:40:16.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.234237ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74992025-01-09T01:40:16.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75002025-01-09T01:40:16.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75012025-01-09T01:40:16.717ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75022025-01-09T01:40:16.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75032025-01-09T01:40:16.718ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75042025-01-09T01:40:16.718ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75052025-01-09T01:40:16.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75062025-01-09T01:40:16.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75072025-01-09T01:40:16.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
75082025-01-09T01:40:16.740ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75092025-01-09T01:40:16.740ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19cb66f4-a187-4b6c-84b9-e5835c841c2a", "content-length": "26", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75102025-01-09T01:40:16.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75112025-01-09T01:40:16.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
75122025-01-09T01:40:16.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75132025-01-09T01:40:16.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
75142025-01-09T01:40:16.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75152025-01-09T01:40:16.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75162025-01-09T01:40:16.752ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.991781ms iteration = 14 status = 0
75172025-01-09T01:40:16.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 150.102534ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75182025-01-09T01:40:16.762ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75192025-01-09T01:40:16.762ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75202025-01-09T01:40:16.763ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.078683ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75212025-01-09T01:40:16.791ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.598971ms iteration = 16 status = {"physical_disks_added":0}
75222025-01-09T01:40:16.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75232025-01-09T01:40:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75242025-01-09T01:40:16.837ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75252025-01-09T01:40:16.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75262025-01-09T01:40:16.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4cf8622-18c8-459d-8b27-a529b49b7d43", "content-length": "372", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75272025-01-09T01:40:16.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75282025-01-09T01:40:16.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75292025-01-09T01:40:16.843ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75302025-01-09T01:40:16.843ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75312025-01-09T01:40:16.843ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70877b36-9fe3-4845-9105-516ff59ae4b0", "content-length": "26", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75322025-01-09T01:40:16.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75332025-01-09T01:40:16.844ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75342025-01-09T01:40:16.844ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75352025-01-09T01:40:16.844ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bacc097c-6890-4dd0-baf5-89dc385b15ab", "content-length": "26", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75362025-01-09T01:40:16.844ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75372025-01-09T01:40:16.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75382025-01-09T01:40:16.847ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75392025-01-09T01:40:16.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75402025-01-09T01:40:16.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75412025-01-09T01:40:16.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75422025-01-09T01:40:16.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75432025-01-09T01:40:16.883ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
75442025-01-09T01:40:16.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75452025-01-09T01:40:16.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c25d5b3-3829-4ae1-9995-d6a4460d3c95", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75462025-01-09T01:40:16.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75472025-01-09T01:40:16.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75482025-01-09T01:40:16.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75492025-01-09T01:40:16.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75502025-01-09T01:40:16.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75512025-01-09T01:40:16.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75522025-01-09T01:40:16.891ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75532025-01-09T01:40:16.891ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75542025-01-09T01:40:16.892ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "90c03765-4553-432d-a95e-323a2f7cc227", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75552025-01-09T01:40:16.893ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.775355ms iteration = 14 status = {}
75562025-01-09T01:40:16.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572025-01-09T01:40:16.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75582025-01-09T01:40:16.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75592025-01-09T01:40:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75602025-01-09T01:40:16.927ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75612025-01-09T01:40:16.927ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "778fc904-b39d-49d4-844a-5ebb67db70f8", "content-length": "1", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75622025-01-09T01:40:16.929ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.188107ms iteration = 14 status = {}
75632025-01-09T01:40:16.930ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75642025-01-09T01:40:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75652025-01-09T01:40:16.933ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.920381ms iteration = 14 status = null
75662025-01-09T01:40:16.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75672025-01-09T01:40:16.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75682025-01-09T01:40:16.992ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
75692025-01-09T01:40:16.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75702025-01-09T01:40:16.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75712025-01-09T01:40:17.007ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75722025-01-09T01:40:17.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "61751b30-74d9-48e0-af7c-46aa92aae6bd", "content-length": "134", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75732025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75742025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
75752025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75762025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75772025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75782025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75792025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75802025-01-09T01:40:17.007ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75812025-01-09T01:40:17.008ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75822025-01-09T01:40:17.008ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75832025-01-09T01:40:17.008ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
75842025-01-09T01:40:17.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75852025-01-09T01:40:17.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75862025-01-09T01:40:17.010ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75872025-01-09T01:40:17.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "716cf51e-9628-4898-8811-1e7b2261988c", "content-length": "2", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75882025-01-09T01:40:17.011ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75892025-01-09T01:40:17.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a9c82ca-51cd-4efc-920a-62c941b74c51", "content-length": "52", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75902025-01-09T01:40:17.011ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
75912025-01-09T01:40:17.011ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75922025-01-09T01:40:17.036ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75932025-01-09T01:40:17.104ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "35654866-49fc-42dd-a44a-c712aa79dbb7", "date": "Thu, 09 Jan 2025 01:40:16 GMT"} })
75942025-01-09T01:40:17.104ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
75952025-01-09T01:40:17.104ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75962025-01-09T01:40:17.105ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fc7c166-b704-4f32-8088-9301ade713dd", "content-length": "682", "date": "Thu, 09 Jan 2025 01:40:17 GMT"} })
75972025-01-09T01:40:17.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75982025-01-09T01:40:17.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75992025-01-09T01:40:17.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76002025-01-09T01:40:17.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a2331f9-d164-4ce5-b04b-f266ad81ef7f", "content-length": "691", "date": "Thu, 09 Jan 2025 01:40:17 GMT"} })
76012025-01-09T01:40:17.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76022025-01-09T01:40:17.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76032025-01-09T01:40:17.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76042025-01-09T01:40:17.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76052025-01-09T01:40:17.110ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 505.872558ms iteration = 14 status = {}
76062025-01-09T01:40:17.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76072025-01-09T01:40:17.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76082025-01-09T01:40:17.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76092025-01-09T01:40:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76102025-01-09T01:40:17.124ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.512047ms iteration = 14 status = {}
76112025-01-09T01:40:17.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d75f60f-c698-495a-b6dc-87e969f00ab9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76122025-01-09T01:40:17.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d75f60f-c698-495a-b6dc-87e969f00ab9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76132025-01-09T01:40:17.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d75f60f-c698-495a-b6dc-87e969f00ab9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76142025-01-09T01:40:18.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = e83eabc4-e7c7-4a0c-bae3-bc2fb8ae88e9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
76152025-01-09T01:40:18.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = e83eabc4-e7c7-4a0c-bae3-bc2fb8ae88e9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
76162025-01-09T01:40:18.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = e83eabc4-e7c7-4a0c-bae3-bc2fb8ae88e9 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
76172025-01-09T01:40:18.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 31522ace-36a3-490f-b9ef-e52e0b19695b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76182025-01-09T01:40:18.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 31522ace-36a3-490f-b9ef-e52e0b19695b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76192025-01-09T01:40:18.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 31522ace-36a3-490f-b9ef-e52e0b19695b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76202025-01-09T01:40:19.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e0a317e-dbc2-4c78-a2ab-daabacec94fe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76212025-01-09T01:40:19.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e0a317e-dbc2-4c78-a2ab-daabacec94fe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76222025-01-09T01:40:19.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3e0a317e-dbc2-4c78-a2ab-daabacec94fe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76232025-01-09T01:40:19.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 534 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 87d0940e-c926-4fe3-bd14-e43bce9412b9 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
76242025-01-09T01:40:20.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c9cf6b06-4308-455c-85e0-74fec48df05b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76252025-01-09T01:40:20.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c9cf6b06-4308-455c-85e0-74fec48df05b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76262025-01-09T01:40:20.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c9cf6b06-4308-455c-85e0-74fec48df05b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76272025-01-09T01:40:21.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f711e10-6d54-47fd-afc4-5741e654e982 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76282025-01-09T01:40:21.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f711e10-6d54-47fd-afc4-5741e654e982 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76292025-01-09T01:40:21.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f711e10-6d54-47fd-afc4-5741e654e982 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76302025-01-09T01:40:22.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5c2070d-804d-4339-b280-e2a573c31389 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76312025-01-09T01:40:22.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5c2070d-804d-4339-b280-e2a573c31389 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76322025-01-09T01:40:22.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5c2070d-804d-4339-b280-e2a573c31389 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76332025-01-09T01:40:23.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 821ae578-aa14-45f3-afbc-d05a1ec8fa9b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76342025-01-09T01:40:23.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 821ae578-aa14-45f3-afbc-d05a1ec8fa9b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76352025-01-09T01:40:23.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 821ae578-aa14-45f3-afbc-d05a1ec8fa9b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76362025-01-09T01:40:24.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c653dff-ccdc-4289-a40e-9c2dc169adf6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76372025-01-09T01:40:24.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c653dff-ccdc-4289-a40e-9c2dc169adf6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76382025-01-09T01:40:24.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c653dff-ccdc-4289-a40e-9c2dc169adf6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76392025-01-09T01:40:25.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9fe03150-000c-429d-beab-08cf527d715a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76402025-01-09T01:40:25.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9fe03150-000c-429d-beab-08cf527d715a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76412025-01-09T01:40:25.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9fe03150-000c-429d-beab-08cf527d715a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76422025-01-09T01:40:26.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 07ec688a-7a0a-4a27-a319-461a147e55bf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76432025-01-09T01:40:26.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 07ec688a-7a0a-4a27-a319-461a147e55bf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76442025-01-09T01:40:26.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 07ec688a-7a0a-4a27-a319-461a147e55bf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76452025-01-09T01:40:26.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
76462025-01-09T01:40:26.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76472025-01-09T01:40:26.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76482025-01-09T01:40:26.604ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
76492025-01-09T01:40:26.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76502025-01-09T01:40:26.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76512025-01-09T01:40:26.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76522025-01-09T01:40:26.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76532025-01-09T01:40:26.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76542025-01-09T01:40:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76552025-01-09T01:40:26.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76562025-01-09T01:40:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76572025-01-09T01:40:26.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76582025-01-09T01:40:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76592025-01-09T01:40:26.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.94706ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76602025-01-09T01:40:26.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76612025-01-09T01:40:26.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
76622025-01-09T01:40:26.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76632025-01-09T01:40:26.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76642025-01-09T01:40:26.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
76652025-01-09T01:40:26.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.097726ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
76662025-01-09T01:40:27.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8e86ecec-5c64-4497-bd6d-19c126a28405 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76672025-01-09T01:40:27.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8e86ecec-5c64-4497-bd6d-19c126a28405 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76682025-01-09T01:40:27.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8e86ecec-5c64-4497-bd6d-19c126a28405 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76692025-01-09T01:40:28.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a330480f-1895-406e-be7f-ee75b39cede2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76702025-01-09T01:40:28.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a330480f-1895-406e-be7f-ee75b39cede2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76712025-01-09T01:40:28.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a330480f-1895-406e-be7f-ee75b39cede2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76722025-01-09T01:40:29.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 95928313-c3e4-4d53-956a-e771d713619b response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
76732025-01-09T01:40:29.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0caa439-d363-40a5-b704-0fc1b8fccb54 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76742025-01-09T01:40:29.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0caa439-d363-40a5-b704-0fc1b8fccb54 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76752025-01-09T01:40:29.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0caa439-d363-40a5-b704-0fc1b8fccb54 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76762025-01-09T01:40:30.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = afa86970-2714-40d8-92d1-b56df8d74f51 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76772025-01-09T01:40:30.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = afa86970-2714-40d8-92d1-b56df8d74f51 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76782025-01-09T01:40:30.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = afa86970-2714-40d8-92d1-b56df8d74f51 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76792025-01-09T01:40:31.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b567d06a-fa39-4726-b1f0-cf5a1b0db876 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76802025-01-09T01:40:31.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b567d06a-fa39-4726-b1f0-cf5a1b0db876 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76812025-01-09T01:40:31.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b567d06a-fa39-4726-b1f0-cf5a1b0db876 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76822025-01-09T01:40:32.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 67bad4b1-87ea-4ff7-be28-f833cb0e1995 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76832025-01-09T01:40:32.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 67bad4b1-87ea-4ff7-be28-f833cb0e1995 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76842025-01-09T01:40:32.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 67bad4b1-87ea-4ff7-be28-f833cb0e1995 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76852025-01-09T01:40:33.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06ecbf97-0196-4056-98d2-4bbe1ff9275a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76862025-01-09T01:40:33.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06ecbf97-0196-4056-98d2-4bbe1ff9275a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76872025-01-09T01:40:33.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06ecbf97-0196-4056-98d2-4bbe1ff9275a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76882025-01-09T01:40:34.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f477697a-6b5b-4587-892e-73f70d0abcaf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76892025-01-09T01:40:34.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f477697a-6b5b-4587-892e-73f70d0abcaf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76902025-01-09T01:40:34.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f477697a-6b5b-4587-892e-73f70d0abcaf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76912025-01-09T01:40:35.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 97f7d7f4-7a62-4017-8a6e-2743bcaf2b54 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76922025-01-09T01:40:35.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 97f7d7f4-7a62-4017-8a6e-2743bcaf2b54 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76932025-01-09T01:40:35.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 97f7d7f4-7a62-4017-8a6e-2743bcaf2b54 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
76942025-01-09T01:40:36.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
76952025-01-09T01:40:36.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76962025-01-09T01:40:36.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76972025-01-09T01:40:36.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
76982025-01-09T01:40:36.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76992025-01-09T01:40:36.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77002025-01-09T01:40:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77012025-01-09T01:40:36.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77022025-01-09T01:40:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77032025-01-09T01:40:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77042025-01-09T01:40:36.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77052025-01-09T01:40:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77062025-01-09T01:40:36.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.358523ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77072025-01-09T01:40:36.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77082025-01-09T01:40:36.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77092025-01-09T01:40:36.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77102025-01-09T01:40:36.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
77112025-01-09T01:40:36.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77122025-01-09T01:40:36.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77132025-01-09T01:40:36.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
77142025-01-09T01:40:36.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.450579ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
77152025-01-09T01:40:36.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b58b56a-6a40-4ef0-9f0a-b5e0e42489ce roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77162025-01-09T01:40:36.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b58b56a-6a40-4ef0-9f0a-b5e0e42489ce resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77172025-01-09T01:40:36.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b58b56a-6a40-4ef0-9f0a-b5e0e42489ce response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77182025-01-09T01:40:37.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0957aca-84f4-41cf-b0fb-3b06f91a1cba roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77192025-01-09T01:40:37.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0957aca-84f4-41cf-b0fb-3b06f91a1cba resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77202025-01-09T01:40:37.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0957aca-84f4-41cf-b0fb-3b06f91a1cba response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77212025-01-09T01:40:38.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11a194c8-5a44-477e-adb0-13053d136ecd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77222025-01-09T01:40:38.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11a194c8-5a44-477e-adb0-13053d136ecd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77232025-01-09T01:40:38.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11a194c8-5a44-477e-adb0-13053d136ecd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77242025-01-09T01:40:39.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = e44937ae-45bb-4a19-b301-ec7cd3ef9d55 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
77252025-01-09T01:40:39.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47939936-d0be-4495-a08e-1ec6baa202da roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77262025-01-09T01:40:39.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47939936-d0be-4495-a08e-1ec6baa202da resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77272025-01-09T01:40:39.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47939936-d0be-4495-a08e-1ec6baa202da response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77282025-01-09T01:40:40.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 247941b9-67b1-4b5b-9a5d-2eef8e467be8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77292025-01-09T01:40:40.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 247941b9-67b1-4b5b-9a5d-2eef8e467be8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77302025-01-09T01:40:40.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 247941b9-67b1-4b5b-9a5d-2eef8e467be8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77312025-01-09T01:40:41.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ce07ff2-b599-4e95-99bb-f26fa5ec40ed roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77322025-01-09T01:40:41.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ce07ff2-b599-4e95-99bb-f26fa5ec40ed resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77332025-01-09T01:40:41.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ce07ff2-b599-4e95-99bb-f26fa5ec40ed response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77342025-01-09T01:40:42.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c48ec13f-7c63-44ca-b114-0ee674207582 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77352025-01-09T01:40:42.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c48ec13f-7c63-44ca-b114-0ee674207582 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77362025-01-09T01:40:42.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c48ec13f-7c63-44ca-b114-0ee674207582 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77372025-01-09T01:40:43.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2417fe57-ac99-460d-9fdd-3c9e41c7f4d3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77382025-01-09T01:40:43.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2417fe57-ac99-460d-9fdd-3c9e41c7f4d3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77392025-01-09T01:40:43.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2417fe57-ac99-460d-9fdd-3c9e41c7f4d3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77402025-01-09T01:40:44.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d5185818-24d0-4853-a303-595a7013943b roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
77412025-01-09T01:40:44.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d5185818-24d0-4853-a303-595a7013943b resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
77422025-01-09T01:40:44.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = d5185818-24d0-4853-a303-595a7013943b response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
77432025-01-09T01:40:44.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = c8cbf2c2-6dbf-4b04-8756-4790de307c9b roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
77442025-01-09T01:40:44.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = c8cbf2c2-6dbf-4b04-8756-4790de307c9b resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
77452025-01-09T01:40:44.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60547 req_id = c8cbf2c2-6dbf-4b04-8756-4790de307c9b response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
77462025-01-09T01:40:44.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95c50279-6398-4ac6-86ce-f6481bf77584 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77472025-01-09T01:40:44.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95c50279-6398-4ac6-86ce-f6481bf77584 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77482025-01-09T01:40:44.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95c50279-6398-4ac6-86ce-f6481bf77584 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77492025-01-09T01:40:45.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d23fc7bd-2644-43f0-b00d-9c2d2587b135 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77502025-01-09T01:40:45.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d23fc7bd-2644-43f0-b00d-9c2d2587b135 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77512025-01-09T01:40:45.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d23fc7bd-2644-43f0-b00d-9c2d2587b135 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
77522025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
77532025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
77542025-01-09T01:40:46.604ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
77552025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.51\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
77562025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
77572025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
77582025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
77592025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
77602025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77612025-01-09T01:40:46.604ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:30:46.604074996 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77622025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
77632025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77642025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
77652025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77662025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
77672025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77682025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77692025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
77702025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77712025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
77722025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
77732025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77742025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
77752025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
77762025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77772025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77782025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77792025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77802025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77812025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
77822025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77832025-01-09T01:40:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77842025-01-09T01:40:46.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 4735617 } })
77852025-01-09T01:40:46.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 4920320 } })
77862025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
77872025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
77882025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77892025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
77902025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77912025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77922025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
77932025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
77942025-01-09T01:40:46.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77952025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77962025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77972025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
77982025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77992025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
78002025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78012025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
78022025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78032025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
78042025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
78052025-01-09T01:40:46.605ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
78062025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
78072025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78082025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78092025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78102025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78112025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78122025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
78132025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.184189ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
78142025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78152025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78162025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78172025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78182025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78192025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78202025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
78212025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78222025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.353591ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
78232025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78242025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78252025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78262025-01-09T01:40:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78272025-01-09T01:40:46.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78282025-01-09T01:40:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78292025-01-09T01:40:46.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78302025-01-09T01:40:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78312025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
78322025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78332025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
78342025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78352025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78362025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
78372025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78382025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78392025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.428584ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78402025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78412025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78422025-01-09T01:40:46.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 7659374 } })
78432025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78442025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
78452025-01-09T01:40:46.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:30:46.604074996 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
78462025-01-09T01:40:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.677819ms iteration = 8 status = {"expiration":"2025-01-09T01:30:46.604074996Z","pruned":[]}
78472025-01-09T01:40:46.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
78482025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78492025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78502025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78512025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78522025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78532025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78542025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78552025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78562025-01-09T01:40:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78572025-01-09T01:40:46.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78582025-01-09T01:40:46.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78592025-01-09T01:40:46.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78602025-01-09T01:40:46.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78612025-01-09T01:40:46.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 13017750 } })
78622025-01-09T01:40:46.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78632025-01-09T01:40:46.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642025-01-09T01:40:46.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652025-01-09T01:40:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78662025-01-09T01:40:46.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78672025-01-09T01:40:46.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78682025-01-09T01:40:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78692025-01-09T01:40:46.621ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.143128ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
78702025-01-09T01:40:46.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78712025-01-09T01:40:46.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78722025-01-09T01:40:46.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78732025-01-09T01:40:46.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78742025-01-09T01:40:46.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78752025-01-09T01:40:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78762025-01-09T01:40:46.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78772025-01-09T01:40:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78782025-01-09T01:40:46.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78792025-01-09T01:40:46.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802025-01-09T01:40:46.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78812025-01-09T01:40:46.669ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78822025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78832025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78842025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
78852025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78862025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78872025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78882025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78892025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78902025-01-09T01:40:46.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78912025-01-09T01:40:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78922025-01-09T01:40:46.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78932025-01-09T01:40:46.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78942025-01-09T01:40:46.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78952025-01-09T01:40:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78962025-01-09T01:40:46.672ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78972025-01-09T01:40:46.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78982025-01-09T01:40:46.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.452359ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
78992025-01-09T01:40:46.673ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79002025-01-09T01:40:46.673ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79012025-01-09T01:40:46.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79022025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79032025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79042025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79052025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79062025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79072025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79082025-01-09T01:40:46.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79092025-01-09T01:40:46.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79102025-01-09T01:40:46.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79112025-01-09T01:40:46.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79122025-01-09T01:40:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79132025-01-09T01:40:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79142025-01-09T01:40:46.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79152025-01-09T01:40:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79162025-01-09T01:40:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79172025-01-09T01:40:46.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79182025-01-09T01:40:46.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79192025-01-09T01:40:46.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79202025-01-09T01:40:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79212025-01-09T01:40:46.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79222025-01-09T01:40:46.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79232025-01-09T01:40:46.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79242025-01-09T01:40:46.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79252025-01-09T01:40:46.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79262025-01-09T01:40:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79272025-01-09T01:40:46.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.185268ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
79282025-01-09T01:40:46.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79292025-01-09T01:40:46.689ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79302025-01-09T01:40:46.689ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79312025-01-09T01:40:46.689ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.606773ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79322025-01-09T01:40:46.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 89956388 } })
79332025-01-09T01:40:46.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
79342025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79352025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79362025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79372025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
79382025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
79392025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
79402025-01-09T01:40:46.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79412025-01-09T01:40:46.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79422025-01-09T01:40:46.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79432025-01-09T01:40:46.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79442025-01-09T01:40:46.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79452025-01-09T01:40:46.695ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
79462025-01-09T01:40:46.695ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.670245ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
79472025-01-09T01:40:46.696ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79482025-01-09T01:40:46.696ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.989363ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79492025-01-09T01:40:46.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79502025-01-09T01:40:46.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79512025-01-09T01:40:46.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79522025-01-09T01:40:46.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79532025-01-09T01:40:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79542025-01-09T01:40:46.740ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79552025-01-09T01:40:46.741ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79562025-01-09T01:40:46.741ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79572025-01-09T01:40:46.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79582025-01-09T01:40:46.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79592025-01-09T01:40:46.747ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79602025-01-09T01:40:46.748ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79612025-01-09T01:40:46.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.880338ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79622025-01-09T01:40:46.748ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 143.355366ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79632025-01-09T01:40:46.748ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79642025-01-09T01:40:46.748ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79652025-01-09T01:40:46.748ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.528409ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79662025-01-09T01:40:46.749ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79672025-01-09T01:40:46.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79682025-01-09T01:40:46.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79692025-01-09T01:40:46.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79702025-01-09T01:40:46.752ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 147.27978ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79712025-01-09T01:40:46.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79722025-01-09T01:40:46.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79732025-01-09T01:40:46.762ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79742025-01-09T01:40:46.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79752025-01-09T01:40:46.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79762025-01-09T01:40:46.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 158.644892ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79772025-01-09T01:40:46.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79782025-01-09T01:40:46.767ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79792025-01-09T01:40:46.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79802025-01-09T01:40:46.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79812025-01-09T01:40:46.767ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79822025-01-09T01:40:46.768ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2976405e-8333-49c2-81ea-e29fc29b7bc4", "content-length": "26", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
79832025-01-09T01:40:46.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79842025-01-09T01:40:46.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79852025-01-09T01:40:46.779ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79862025-01-09T01:40:46.779ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79872025-01-09T01:40:46.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79882025-01-09T01:40:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79892025-01-09T01:40:46.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79902025-01-09T01:40:46.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79912025-01-09T01:40:46.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79922025-01-09T01:40:46.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79932025-01-09T01:40:46.788ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
79942025-01-09T01:40:46.788ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79952025-01-09T01:40:46.788ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
79962025-01-09T01:40:46.788ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 184.166902ms iteration = 8 status = {"generation":1}
79972025-01-09T01:40:46.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79982025-01-09T01:40:46.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79992025-01-09T01:40:46.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80002025-01-09T01:40:46.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80012025-01-09T01:40:46.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
80022025-01-09T01:40:46.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80032025-01-09T01:40:46.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.825114ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80042025-01-09T01:40:46.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80052025-01-09T01:40:46.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80062025-01-09T01:40:46.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80072025-01-09T01:40:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80082025-01-09T01:40:46.800ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 195.591147ms iteration = 15 status = 0
80092025-01-09T01:40:46.801ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80102025-01-09T01:40:46.801ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
80112025-01-09T01:40:46.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80122025-01-09T01:40:46.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80132025-01-09T01:40:46.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80142025-01-09T01:40:46.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80152025-01-09T01:40:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80162025-01-09T01:40:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80172025-01-09T01:40:46.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80182025-01-09T01:40:46.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192025-01-09T01:40:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80202025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
80212025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
80222025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
80232025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 205.087719ms iteration = 8 status = {"generation":2}
80242025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80252025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80262025-01-09T01:40:46.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80272025-01-09T01:40:46.814ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80282025-01-09T01:40:46.814ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80292025-01-09T01:40:46.815ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bb426d5-b3ea-4617-bbbc-39ee325d2a42", "content-length": "26", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
80302025-01-09T01:40:46.815ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80312025-01-09T01:40:46.816ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80322025-01-09T01:40:46.822ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
80332025-01-09T01:40:46.822ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 218.436504ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80342025-01-09T01:40:46.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e1569e5-2a6c-421a-aaa3-78b8ebed8c01 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
80352025-01-09T01:40:46.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e1569e5-2a6c-421a-aaa3-78b8ebed8c01 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
80362025-01-09T01:40:46.851ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
80372025-01-09T01:40:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 246.130979ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80382025-01-09T01:40:46.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
80392025-01-09T01:40:46.851ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80402025-01-09T01:40:46.851ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 246.562386ms iteration = 17 status = {"physical_disks_added":0}
80412025-01-09T01:40:46.851ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0615cef4-d86a-472a-b36b-191ab79546d9", "content-length": "26", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
80422025-01-09T01:40:46.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80432025-01-09T01:40:46.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
80442025-01-09T01:40:46.873ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80452025-01-09T01:40:46.961ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
80462025-01-09T01:40:47.190ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 586.462114ms iteration = 15 status = {}
80472025-01-09T01:40:47.201ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80482025-01-09T01:40:47.220ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80492025-01-09T01:40:47.220ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "52381ec6-3a76-4648-8a76-80bc605c0fa9", "content-length": "1", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
80502025-01-09T01:40:47.221ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80512025-01-09T01:40:47.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80522025-01-09T01:40:47.228ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80532025-01-09T01:40:47.228ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80542025-01-09T01:40:47.229ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "82d62044-357a-4c92-aaef-8ec348af2198", "content-length": "372", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} })
80552025-01-09T01:40:47.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80562025-01-09T01:40:47.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80572025-01-09T01:40:47.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80582025-01-09T01:40:47.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 392047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e1569e5-2a6c-421a-aaa3-78b8ebed8c01 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
80592025-01-09T01:40:47.232ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 627.847359ms iteration = 15 status = null
80602025-01-09T01:40:47.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80612025-01-09T01:40:47.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80622025-01-09T01:40:47.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80632025-01-09T01:40:47.245ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80642025-01-09T01:40:47.246ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80652025-01-09T01:40:47.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80662025-01-09T01:40:47.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ac33d0e4-efc4-486c-8e31-51a14bf2f8be", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80672025-01-09T01:40:47.277ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80682025-01-09T01:40:47.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c44b04e9-37a2-4da8-a229-e31ae364fbcf", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80692025-01-09T01:40:47.279ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80702025-01-09T01:40:47.281ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80712025-01-09T01:40:47.281ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 677.180203ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80722025-01-09T01:40:47.340ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "07ba63ab-e140-4918-aa7d-757522f89625", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} })
80732025-01-09T01:40:47.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80742025-01-09T01:40:47.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80752025-01-09T01:40:47.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80762025-01-09T01:40:47.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80772025-01-09T01:40:47.342ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80782025-01-09T01:40:47.343ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
80792025-01-09T01:40:47.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80802025-01-09T01:40:47.343ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46efc745-85cf-47ef-b7b1-410b75f26c28", "content-length": "691", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} })
80812025-01-09T01:40:47.343ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80822025-01-09T01:40:47.343ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80832025-01-09T01:40:47.343ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80842025-01-09T01:40:47.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80852025-01-09T01:40:47.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80862025-01-09T01:40:47.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80872025-01-09T01:40:47.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80882025-01-09T01:40:47.344ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "aa5dbee7-58a0-4674-bfcd-c5cdcf293533", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80892025-01-09T01:40:47.344ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80902025-01-09T01:40:47.345ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 740.711205ms iteration = 15 status = {}
80912025-01-09T01:40:47.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2205a62-ee90-4a64-8296-8e7c7148205f", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80922025-01-09T01:40:47.346ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80932025-01-09T01:40:47.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80942025-01-09T01:40:47.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80952025-01-09T01:40:47.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "30b4b064-4478-424b-b216-572bd988a6b6", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80962025-01-09T01:40:47.348ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80972025-01-09T01:40:47.349ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80982025-01-09T01:40:47.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 746.03232ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80992025-01-09T01:40:47.350ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81002025-01-09T01:40:47.350ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81012025-01-09T01:40:47.350ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c45210cc-175b-4dcb-82af-a14b2f05d7eb", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} })
81022025-01-09T01:40:47.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81032025-01-09T01:40:47.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "622cb721-ed7f-413b-a52a-c9309379c25b", "content-length": "134", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
81042025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81052025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
81062025-01-09T01:40:47.352ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 747.647846ms iteration = 15 status = {}
81072025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81082025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81092025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81102025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81112025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81122025-01-09T01:40:47.352ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81132025-01-09T01:40:47.353ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81142025-01-09T01:40:47.353ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81152025-01-09T01:40:47.353ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
81162025-01-09T01:40:47.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81172025-01-09T01:40:47.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81182025-01-09T01:40:47.354ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81192025-01-09T01:40:47.354ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8201c060-56eb-410d-8f7a-f23d2d16c028", "content-length": "2", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
81202025-01-09T01:40:47.354ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81212025-01-09T01:40:47.354ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc23dc73-fa9d-4595-be8f-970451063dab", "content-length": "52", "date": "Thu, 09 Jan 2025 01:40:46 GMT"} })
81222025-01-09T01:40:47.354ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
81232025-01-09T01:40:47.354ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81242025-01-09T01:40:47.447ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d4d74050-2b4b-4dcc-a95c-c16682663430", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} })
81252025-01-09T01:40:47.447ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
81262025-01-09T01:40:47.447ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81272025-01-09T01:40:47.447ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "caf388f4-d01d-439b-845d-6cc77588a375", "content-length": "682", "date": "Thu, 09 Jan 2025 01:40:47 GMT"} })
81282025-01-09T01:40:47.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81292025-01-09T01:40:47.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81302025-01-09T01:40:47.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81312025-01-09T01:40:47.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81322025-01-09T01:40:47.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81332025-01-09T01:40:47.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81342025-01-09T01:40:47.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81352025-01-09T01:40:47.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81362025-01-09T01:40:47.464ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 859.825711ms iteration = 15 status = {}
81372025-01-09T01:40:48.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c05d4053-b3a2-4ea7-97c4-a1701984e5d4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
81382025-01-09T01:40:48.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c05d4053-b3a2-4ea7-97c4-a1701984e5d4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
81392025-01-09T01:40:48.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c05d4053-b3a2-4ea7-97c4-a1701984e5d4 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
81402025-01-09T01:40:48.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e55e2304-2fca-4a93-ad52-3cf129f72f38 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81412025-01-09T01:40:48.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e55e2304-2fca-4a93-ad52-3cf129f72f38 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81422025-01-09T01:40:48.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e55e2304-2fca-4a93-ad52-3cf129f72f38 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81432025-01-09T01:40:49.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 4ad71f13-4481-484b-ac6c-7d24225b1afe response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
81442025-01-09T01:40:49.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c2b27c1-d070-40cb-8008-8b697b2c0981 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81452025-01-09T01:40:49.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c2b27c1-d070-40cb-8008-8b697b2c0981 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81462025-01-09T01:40:49.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c2b27c1-d070-40cb-8008-8b697b2c0981 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81472025-01-09T01:40:50.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29aa0829-ed60-4f7d-b62c-7316f9bc45b3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81482025-01-09T01:40:50.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29aa0829-ed60-4f7d-b62c-7316f9bc45b3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81492025-01-09T01:40:50.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29aa0829-ed60-4f7d-b62c-7316f9bc45b3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81502025-01-09T01:40:51.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0231ae9-fe22-4cac-8bc5-8e92932a026c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81512025-01-09T01:40:51.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0231ae9-fe22-4cac-8bc5-8e92932a026c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81522025-01-09T01:40:51.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0231ae9-fe22-4cac-8bc5-8e92932a026c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81532025-01-09T01:40:52.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b5fd9907-99b9-4711-99d5-cd66b96a5679 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81542025-01-09T01:40:52.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b5fd9907-99b9-4711-99d5-cd66b96a5679 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81552025-01-09T01:40:52.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b5fd9907-99b9-4711-99d5-cd66b96a5679 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81562025-01-09T01:40:53.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b5f113c-3bde-4686-81e5-46ea0422b9c7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81572025-01-09T01:40:53.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b5f113c-3bde-4686-81e5-46ea0422b9c7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81582025-01-09T01:40:53.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9b5f113c-3bde-4686-81e5-46ea0422b9c7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81592025-01-09T01:40:54.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5cba39c0-7dda-467b-9f23-9d288660a83b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81602025-01-09T01:40:54.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5cba39c0-7dda-467b-9f23-9d288660a83b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81612025-01-09T01:40:54.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5cba39c0-7dda-467b-9f23-9d288660a83b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81622025-01-09T01:40:55.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0f588fde-4f99-4dad-97bd-632627eee0d9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81632025-01-09T01:40:55.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0f588fde-4f99-4dad-97bd-632627eee0d9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81642025-01-09T01:40:55.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0f588fde-4f99-4dad-97bd-632627eee0d9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81652025-01-09T01:40:56.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b10c15af-0a02-4223-bf54-53da53bdf85c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81662025-01-09T01:40:56.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b10c15af-0a02-4223-bf54-53da53bdf85c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81672025-01-09T01:40:56.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b10c15af-0a02-4223-bf54-53da53bdf85c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81682025-01-09T01:40:56.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
81692025-01-09T01:40:56.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81702025-01-09T01:40:56.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81712025-01-09T01:40:56.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
81722025-01-09T01:40:56.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81732025-01-09T01:40:56.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81742025-01-09T01:40:56.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81752025-01-09T01:40:56.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81762025-01-09T01:40:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81772025-01-09T01:40:56.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.688589ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81782025-01-09T01:40:56.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81792025-01-09T01:40:56.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81802025-01-09T01:40:56.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81812025-01-09T01:40:56.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81822025-01-09T01:40:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81832025-01-09T01:40:56.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81842025-01-09T01:40:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
81852025-01-09T01:40:56.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81862025-01-09T01:40:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81872025-01-09T01:40:56.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
81882025-01-09T01:40:56.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.169771ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
81892025-01-09T01:40:57.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c335c5ef-fd0a-4933-9d2e-df955b70f6a9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81902025-01-09T01:40:57.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c335c5ef-fd0a-4933-9d2e-df955b70f6a9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81912025-01-09T01:40:57.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c335c5ef-fd0a-4933-9d2e-df955b70f6a9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81922025-01-09T01:40:58.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d30e10a-19f7-4ff4-8b35-e7c5e5d6fdb6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81932025-01-09T01:40:58.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d30e10a-19f7-4ff4-8b35-e7c5e5d6fdb6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81942025-01-09T01:40:58.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d30e10a-19f7-4ff4-8b35-e7c5e5d6fdb6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81952025-01-09T01:40:59.295ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 0fd0fab1-1555-4e7e-b231-7cc17409e6b0 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
81962025-01-09T01:40:59.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 047344a1-f0ee-4118-a484-76c68e1b8be5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81972025-01-09T01:40:59.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 047344a1-f0ee-4118-a484-76c68e1b8be5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81982025-01-09T01:40:59.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 047344a1-f0ee-4118-a484-76c68e1b8be5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
81992025-01-09T01:41:00.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b77c1cc-0a4b-493d-bef4-f192271ba93a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82002025-01-09T01:41:00.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b77c1cc-0a4b-493d-bef4-f192271ba93a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82012025-01-09T01:41:00.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b77c1cc-0a4b-493d-bef4-f192271ba93a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82022025-01-09T01:41:01.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d72c90a-ff1d-4f37-84bc-53426597a6bc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82032025-01-09T01:41:01.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d72c90a-ff1d-4f37-84bc-53426597a6bc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82042025-01-09T01:41:01.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d72c90a-ff1d-4f37-84bc-53426597a6bc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82052025-01-09T01:41:02.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6100965f-ce3a-4797-92cf-edeb186ee656 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82062025-01-09T01:41:02.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6100965f-ce3a-4797-92cf-edeb186ee656 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82072025-01-09T01:41:02.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6100965f-ce3a-4797-92cf-edeb186ee656 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82082025-01-09T01:41:03.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8fc5b0e7-49d4-4bc7-8d21-dc22147e1b49 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82092025-01-09T01:41:03.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8fc5b0e7-49d4-4bc7-8d21-dc22147e1b49 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82102025-01-09T01:41:03.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8fc5b0e7-49d4-4bc7-8d21-dc22147e1b49 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82112025-01-09T01:41:04.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c30c9e16-7bed-44aa-9661-9385b544fe96 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82122025-01-09T01:41:04.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c30c9e16-7bed-44aa-9661-9385b544fe96 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82132025-01-09T01:41:04.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c30c9e16-7bed-44aa-9661-9385b544fe96 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82142025-01-09T01:41:05.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 742bf516-b1e9-422c-8cc5-bee533194a7e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82152025-01-09T01:41:05.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 742bf516-b1e9-422c-8cc5-bee533194a7e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82162025-01-09T01:41:05.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 742bf516-b1e9-422c-8cc5-bee533194a7e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82172025-01-09T01:41:06.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
82182025-01-09T01:41:06.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82192025-01-09T01:41:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82202025-01-09T01:41:06.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
82212025-01-09T01:41:06.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82222025-01-09T01:41:06.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82232025-01-09T01:41:06.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82242025-01-09T01:41:06.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82252025-01-09T01:41:06.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82262025-01-09T01:41:06.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.456996ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82272025-01-09T01:41:06.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82282025-01-09T01:41:06.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82292025-01-09T01:41:06.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82302025-01-09T01:41:06.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82312025-01-09T01:41:06.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82322025-01-09T01:41:06.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82332025-01-09T01:41:06.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
82342025-01-09T01:41:06.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82352025-01-09T01:41:06.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82362025-01-09T01:41:06.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
82372025-01-09T01:41:06.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.174174ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
82382025-01-09T01:41:06.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 734c7b80-3106-461d-b809-329fdd83217b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82392025-01-09T01:41:06.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 734c7b80-3106-461d-b809-329fdd83217b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82402025-01-09T01:41:06.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 734c7b80-3106-461d-b809-329fdd83217b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82412025-01-09T01:41:07.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bba474e-4c94-4dc0-80be-f916a434fdbd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82422025-01-09T01:41:07.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bba474e-4c94-4dc0-80be-f916a434fdbd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82432025-01-09T01:41:07.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bba474e-4c94-4dc0-80be-f916a434fdbd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82442025-01-09T01:41:08.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d9f931c-06cb-4766-bb74-a5d23cdb5de2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82452025-01-09T01:41:08.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d9f931c-06cb-4766-bb74-a5d23cdb5de2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82462025-01-09T01:41:08.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d9f931c-06cb-4766-bb74-a5d23cdb5de2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82472025-01-09T01:41:09.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = ffee7a09-352b-4482-baf5-fc51d68944f7 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
82482025-01-09T01:41:09.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4dc04965-9bd3-41e7-8abd-6b11e5a585c2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82492025-01-09T01:41:09.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4dc04965-9bd3-41e7-8abd-6b11e5a585c2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82502025-01-09T01:41:09.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4dc04965-9bd3-41e7-8abd-6b11e5a585c2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82512025-01-09T01:41:10.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b25fc575-be5f-498f-ac4d-b080dfc7dee7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82522025-01-09T01:41:10.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b25fc575-be5f-498f-ac4d-b080dfc7dee7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82532025-01-09T01:41:10.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b25fc575-be5f-498f-ac4d-b080dfc7dee7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82542025-01-09T01:41:11.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe873457-28df-44ab-a4b6-16f8cd85ccc0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82552025-01-09T01:41:11.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe873457-28df-44ab-a4b6-16f8cd85ccc0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82562025-01-09T01:41:11.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe873457-28df-44ab-a4b6-16f8cd85ccc0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82572025-01-09T01:41:12.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6f19faeb-a163-4907-9b4b-ee122b010554 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82582025-01-09T01:41:12.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6f19faeb-a163-4907-9b4b-ee122b010554 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82592025-01-09T01:41:12.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6f19faeb-a163-4907-9b4b-ee122b010554 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82602025-01-09T01:41:13.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a54f2336-011c-4072-896a-f4cac6f8d266 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82612025-01-09T01:41:13.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a54f2336-011c-4072-896a-f4cac6f8d266 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82622025-01-09T01:41:13.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a54f2336-011c-4072-896a-f4cac6f8d266 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82632025-01-09T01:41:14.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc598e56-8962-4a31-b581-428c5efff6d3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82642025-01-09T01:41:14.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc598e56-8962-4a31-b581-428c5efff6d3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82652025-01-09T01:41:14.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc598e56-8962-4a31-b581-428c5efff6d3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82662025-01-09T01:41:15.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d195323c-be27-42f9-b375-f0d77fbe87d2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82672025-01-09T01:41:15.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d195323c-be27-42f9-b375-f0d77fbe87d2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82682025-01-09T01:41:15.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d195323c-be27-42f9-b375-f0d77fbe87d2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
82692025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
82702025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
82712025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82722025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82732025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
82742025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
82752025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82762025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
82772025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
82782025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82792025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82802025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
82812025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82822025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82832025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
82842025-01-09T01:41:16.605ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82852025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
82862025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82872025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82882025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
82892025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82902025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
82912025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
82922025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82932025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82942025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
82952025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82962025-01-09T01:41:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82972025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82982025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82992025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83002025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83012025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83022025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83032025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83042025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83052025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83062025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83072025-01-09T01:41:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83082025-01-09T01:41:16.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83092025-01-09T01:41:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
83102025-01-09T01:41:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83112025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83122025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83132025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83142025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83152025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
83162025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83172025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
83182025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83192025-01-09T01:41:16.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1409, tv_nsec: 7996939 } })
83202025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83212025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83222025-01-09T01:41:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83232025-01-09T01:41:16.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
83242025-01-09T01:41:16.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83252025-01-09T01:41:16.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.931293ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83262025-01-09T01:41:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83272025-01-09T01:41:16.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83282025-01-09T01:41:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83292025-01-09T01:41:16.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83302025-01-09T01:41:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83312025-01-09T01:41:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83322025-01-09T01:41:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83332025-01-09T01:41:16.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83342025-01-09T01:41:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83352025-01-09T01:41:16.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1409, tv_nsec: 12612254 } })
83362025-01-09T01:41:16.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372025-01-09T01:41:16.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
83382025-01-09T01:41:16.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392025-01-09T01:41:16.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83402025-01-09T01:41:16.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83412025-01-09T01:41:16.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83422025-01-09T01:41:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83432025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83442025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83452025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83462025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83472025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83482025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83492025-01-09T01:41:16.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83502025-01-09T01:41:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83512025-01-09T01:41:16.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83522025-01-09T01:41:16.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83532025-01-09T01:41:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83542025-01-09T01:41:16.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1409, tv_nsec: 21258983 } })
83552025-01-09T01:41:16.621ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
83562025-01-09T01:41:16.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83572025-01-09T01:41:16.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83582025-01-09T01:41:16.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83592025-01-09T01:41:16.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83602025-01-09T01:41:16.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83612025-01-09T01:41:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83622025-01-09T01:41:16.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83632025-01-09T01:41:16.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83642025-01-09T01:41:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83652025-01-09T01:41:16.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83662025-01-09T01:41:16.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83672025-01-09T01:41:16.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83682025-01-09T01:41:16.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83692025-01-09T01:41:16.647ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83702025-01-09T01:41:16.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83712025-01-09T01:41:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83722025-01-09T01:41:16.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.723813ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83732025-01-09T01:41:16.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.567198ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
83742025-01-09T01:41:16.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83752025-01-09T01:41:16.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83762025-01-09T01:41:16.650ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83772025-01-09T01:41:16.650ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83782025-01-09T01:41:16.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83792025-01-09T01:41:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83802025-01-09T01:41:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
83812025-01-09T01:41:16.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83822025-01-09T01:41:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83832025-01-09T01:41:16.653ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.973882ms iteration = 16 status = 0
83842025-01-09T01:41:16.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83852025-01-09T01:41:16.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.437499ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83862025-01-09T01:41:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83872025-01-09T01:41:16.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.573349ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
83882025-01-09T01:41:16.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83892025-01-09T01:41:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83902025-01-09T01:41:16.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.204637ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
83912025-01-09T01:41:16.659ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83922025-01-09T01:41:16.659ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83932025-01-09T01:41:16.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83942025-01-09T01:41:16.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83952025-01-09T01:41:16.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83962025-01-09T01:41:16.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83972025-01-09T01:41:16.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83982025-01-09T01:41:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83992025-01-09T01:41:16.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002025-01-09T01:41:16.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.963934ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84012025-01-09T01:41:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
84022025-01-09T01:41:16.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84032025-01-09T01:41:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84042025-01-09T01:41:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84052025-01-09T01:41:16.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84062025-01-09T01:41:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84072025-01-09T01:41:16.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84082025-01-09T01:41:16.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84092025-01-09T01:41:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84102025-01-09T01:41:16.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112025-01-09T01:41:16.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84122025-01-09T01:41:16.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84132025-01-09T01:41:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84142025-01-09T01:41:16.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84152025-01-09T01:41:16.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.282479ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84162025-01-09T01:41:16.696ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
84172025-01-09T01:41:16.696ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.987774ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
84182025-01-09T01:41:16.712ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84192025-01-09T01:41:16.713ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84202025-01-09T01:41:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.51225ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84212025-01-09T01:41:16.718ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.367064ms iteration = 18 status = {"physical_disks_added":0}
84222025-01-09T01:41:16.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84232025-01-09T01:41:16.751ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84242025-01-09T01:41:16.751ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b4dfe86-cdd8-4117-9656-67876a2ba5e9", "content-length": "26", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84252025-01-09T01:41:16.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84262025-01-09T01:41:16.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84272025-01-09T01:41:16.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84282025-01-09T01:41:16.834ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f99f95e4-7f2c-4b8d-b9bb-15547f98dcfc", "content-length": "691", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84292025-01-09T01:41:16.834ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84302025-01-09T01:41:16.834ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84312025-01-09T01:41:16.834ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84322025-01-09T01:41:16.835ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 230.067771ms iteration = 16 status = {}
84332025-01-09T01:41:16.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84342025-01-09T01:41:16.866ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84352025-01-09T01:41:16.867ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf2f0ab9-9ff1-4e7e-83a9-924981af7a81", "content-length": "26", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84362025-01-09T01:41:16.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84372025-01-09T01:41:16.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84382025-01-09T01:41:16.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc68fb20-122b-4108-af27-12db0b218581 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
84392025-01-09T01:41:16.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc68fb20-122b-4108-af27-12db0b218581 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
84402025-01-09T01:41:16.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc68fb20-122b-4108-af27-12db0b218581 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
84412025-01-09T01:41:16.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
84422025-01-09T01:41:16.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84432025-01-09T01:41:16.974ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9cbc01e-c539-4c6e-ba10-97d7e6a31ba9", "content-length": "26", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84442025-01-09T01:41:16.974ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84452025-01-09T01:41:16.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
84462025-01-09T01:41:16.999ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84472025-01-09T01:41:17.000ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "179f81a3-ccc6-4fb2-bc4c-25adaf8d3238", "content-length": "1", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84482025-01-09T01:41:17.002ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84492025-01-09T01:41:17.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84502025-01-09T01:41:17.004ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.125ms iteration = 16 status = null
84512025-01-09T01:41:17.040ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84522025-01-09T01:41:17.040ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84532025-01-09T01:41:17.079ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 474.061746ms iteration = 16 status = {}
84542025-01-09T01:41:17.103ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc820af7-b49e-4a14-8fbf-7e834af0fa06", "content-length": "372", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84552025-01-09T01:41:17.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84562025-01-09T01:41:17.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84572025-01-09T01:41:17.117ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84582025-01-09T01:41:17.117ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84592025-01-09T01:41:17.117ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "59cd74b2-beef-4769-a360-a7ef86bfa51e", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84602025-01-09T01:41:17.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84612025-01-09T01:41:17.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84622025-01-09T01:41:17.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84632025-01-09T01:41:17.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84642025-01-09T01:41:17.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84652025-01-09T01:41:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84662025-01-09T01:41:17.126ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84672025-01-09T01:41:17.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84682025-01-09T01:41:17.127ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d146457a-1bd9-4b26-ac9c-0dd1ea61d584", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84692025-01-09T01:41:17.128ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 523.43964ms iteration = 16 status = {}
84702025-01-09T01:41:17.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84712025-01-09T01:41:17.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84722025-01-09T01:41:17.162ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
84732025-01-09T01:41:17.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84742025-01-09T01:41:17.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84752025-01-09T01:41:17.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84762025-01-09T01:41:17.170ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "937d8858-c9de-467d-8793-accb3bfab2f3", "content-length": "134", "date": "Thu, 09 Jan 2025 01:41:17 GMT"} })
84772025-01-09T01:41:17.170ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84782025-01-09T01:41:17.170ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
84792025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84802025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84812025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84822025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84832025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84842025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84852025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84862025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84872025-01-09T01:41:17.171ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
84882025-01-09T01:41:17.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84892025-01-09T01:41:17.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84902025-01-09T01:41:17.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84912025-01-09T01:41:17.173ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "67d2d85f-4469-4375-a5ac-518a8ef98ddd", "content-length": "2", "date": "Thu, 09 Jan 2025 01:41:17 GMT"} })
84922025-01-09T01:41:17.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84932025-01-09T01:41:17.173ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "39fb55d0-5ab1-407b-bb5f-bb5a9458641a", "content-length": "52", "date": "Thu, 09 Jan 2025 01:41:17 GMT"} })
84942025-01-09T01:41:17.174ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
84952025-01-09T01:41:17.174ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84962025-01-09T01:41:17.267ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fc0505a5-8216-4dd5-9f14-6699eee19deb", "date": "Thu, 09 Jan 2025 01:41:16 GMT"} })
84972025-01-09T01:41:17.267ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
84982025-01-09T01:41:17.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84992025-01-09T01:41:17.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "078c26df-9969-4512-b82e-f1c0b5f5e835", "content-length": "682", "date": "Thu, 09 Jan 2025 01:41:17 GMT"} })
85002025-01-09T01:41:17.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85012025-01-09T01:41:17.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85022025-01-09T01:41:17.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85032025-01-09T01:41:17.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85042025-01-09T01:41:17.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85052025-01-09T01:41:17.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85062025-01-09T01:41:17.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85072025-01-09T01:41:17.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85082025-01-09T01:41:17.282ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 677.078642ms iteration = 16 status = {}
85092025-01-09T01:41:17.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4226a7a-720a-4c66-a01d-8726a5aa11c9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85102025-01-09T01:41:17.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4226a7a-720a-4c66-a01d-8726a5aa11c9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85112025-01-09T01:41:17.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4226a7a-720a-4c66-a01d-8726a5aa11c9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85122025-01-09T01:41:18.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c1e1d40d-482d-42d0-9991-52bf0d251886 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
85132025-01-09T01:41:18.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c1e1d40d-482d-42d0-9991-52bf0d251886 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
85142025-01-09T01:41:18.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c1e1d40d-482d-42d0-9991-52bf0d251886 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
85152025-01-09T01:41:18.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb035978-9112-4c9d-84e8-72a1122448c3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85162025-01-09T01:41:18.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb035978-9112-4c9d-84e8-72a1122448c3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85172025-01-09T01:41:18.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb035978-9112-4c9d-84e8-72a1122448c3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85182025-01-09T01:41:19.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 51e3462d-6cd1-4d28-b0e4-782f41e3ed8b response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
85192025-01-09T01:41:20.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1efd86bd-0a99-401f-ae86-c1654ba0201e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85202025-01-09T01:41:20.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1efd86bd-0a99-401f-ae86-c1654ba0201e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85212025-01-09T01:41:20.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1efd86bd-0a99-401f-ae86-c1654ba0201e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85222025-01-09T01:41:21.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 100485b9-8218-4b00-b63b-3d8aa4c66fef roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85232025-01-09T01:41:21.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 100485b9-8218-4b00-b63b-3d8aa4c66fef resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85242025-01-09T01:41:21.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 100485b9-8218-4b00-b63b-3d8aa4c66fef response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85252025-01-09T01:41:22.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e428114f-2cea-46ab-95c8-a41c5ab3af3e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85262025-01-09T01:41:22.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e428114f-2cea-46ab-95c8-a41c5ab3af3e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85272025-01-09T01:41:22.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e428114f-2cea-46ab-95c8-a41c5ab3af3e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85282025-01-09T01:41:23.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f942a0a1-a93b-46d3-b501-5d893c211e05 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85292025-01-09T01:41:23.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f942a0a1-a93b-46d3-b501-5d893c211e05 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85302025-01-09T01:41:23.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f942a0a1-a93b-46d3-b501-5d893c211e05 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85312025-01-09T01:41:24.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3967116-1942-4856-b610-b520f66bdded roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85322025-01-09T01:41:24.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3967116-1942-4856-b610-b520f66bdded resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85332025-01-09T01:41:24.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3967116-1942-4856-b610-b520f66bdded response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85342025-01-09T01:41:25.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d05aef0-db1c-49bd-b66c-5fb492efa53e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85352025-01-09T01:41:25.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d05aef0-db1c-49bd-b66c-5fb492efa53e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85362025-01-09T01:41:25.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d05aef0-db1c-49bd-b66c-5fb492efa53e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85372025-01-09T01:41:26.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01290b9c-7cb5-44ca-936b-f91b4c005a15 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85382025-01-09T01:41:26.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01290b9c-7cb5-44ca-936b-f91b4c005a15 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85392025-01-09T01:41:26.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01290b9c-7cb5-44ca-936b-f91b4c005a15 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85402025-01-09T01:41:26.604ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
85412025-01-09T01:41:26.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85422025-01-09T01:41:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85432025-01-09T01:41:26.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
85442025-01-09T01:41:26.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85452025-01-09T01:41:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85462025-01-09T01:41:26.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85472025-01-09T01:41:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85482025-01-09T01:41:26.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85492025-01-09T01:41:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85502025-01-09T01:41:26.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85512025-01-09T01:41:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85522025-01-09T01:41:26.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85532025-01-09T01:41:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
85542025-01-09T01:41:26.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85552025-01-09T01:41:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85562025-01-09T01:41:26.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
85572025-01-09T01:41:26.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.13062ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
85582025-01-09T01:41:26.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85592025-01-09T01:41:26.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85602025-01-09T01:41:26.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.866438ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85612025-01-09T01:41:27.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d07a5ddb-2d8c-4e7b-be15-33c695207fdd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85622025-01-09T01:41:27.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d07a5ddb-2d8c-4e7b-be15-33c695207fdd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85632025-01-09T01:41:27.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d07a5ddb-2d8c-4e7b-be15-33c695207fdd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85642025-01-09T01:41:28.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9e5c98b9-0b8a-49c2-b207-29be25185969 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85652025-01-09T01:41:28.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9e5c98b9-0b8a-49c2-b207-29be25185969 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85662025-01-09T01:41:28.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9e5c98b9-0b8a-49c2-b207-29be25185969 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85672025-01-09T01:41:29.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3faa8484-17bf-49f0-afea-02781f78910d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85682025-01-09T01:41:29.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3faa8484-17bf-49f0-afea-02781f78910d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85692025-01-09T01:41:29.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3faa8484-17bf-49f0-afea-02781f78910d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85702025-01-09T01:41:29.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 519 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = af32a2e9-22b5-46e4-b590-347b94864037 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
85712025-01-09T01:41:30.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eda251c9-068d-4d11-b27d-47a0ce1729cc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85722025-01-09T01:41:30.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eda251c9-068d-4d11-b27d-47a0ce1729cc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85732025-01-09T01:41:30.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eda251c9-068d-4d11-b27d-47a0ce1729cc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85742025-01-09T01:41:31.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 767f49cf-67ac-44e4-bfcc-1f36cb467973 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85752025-01-09T01:41:31.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 767f49cf-67ac-44e4-bfcc-1f36cb467973 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85762025-01-09T01:41:31.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 767f49cf-67ac-44e4-bfcc-1f36cb467973 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85772025-01-09T01:41:32.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d8014c78-ea20-44f0-870c-5d35314c9b09 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85782025-01-09T01:41:32.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d8014c78-ea20-44f0-870c-5d35314c9b09 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85792025-01-09T01:41:32.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d8014c78-ea20-44f0-870c-5d35314c9b09 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85802025-01-09T01:41:33.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2271897-d900-41b7-9911-3187b915f3ad roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85812025-01-09T01:41:33.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2271897-d900-41b7-9911-3187b915f3ad resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85822025-01-09T01:41:33.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2271897-d900-41b7-9911-3187b915f3ad response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85832025-01-09T01:41:34.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fd484d02-58d7-4135-9ce3-96782f729495 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85842025-01-09T01:41:34.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fd484d02-58d7-4135-9ce3-96782f729495 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85852025-01-09T01:41:34.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fd484d02-58d7-4135-9ce3-96782f729495 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85862025-01-09T01:41:35.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 999c2bed-ad27-4283-8ef8-8e2907ff6365 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85872025-01-09T01:41:35.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 999c2bed-ad27-4283-8ef8-8e2907ff6365 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85882025-01-09T01:41:35.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 999c2bed-ad27-4283-8ef8-8e2907ff6365 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85892025-01-09T01:41:36.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0cb1d628-539a-4eba-b8bf-360aef85b2a8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85902025-01-09T01:41:36.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0cb1d628-539a-4eba-b8bf-360aef85b2a8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85912025-01-09T01:41:36.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0cb1d628-539a-4eba-b8bf-360aef85b2a8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
85922025-01-09T01:41:36.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
85932025-01-09T01:41:36.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85942025-01-09T01:41:36.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85952025-01-09T01:41:36.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
85962025-01-09T01:41:36.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85972025-01-09T01:41:36.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85982025-01-09T01:41:36.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992025-01-09T01:41:36.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86002025-01-09T01:41:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86012025-01-09T01:41:36.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.433296ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86022025-01-09T01:41:36.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86032025-01-09T01:41:36.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86042025-01-09T01:41:36.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86052025-01-09T01:41:36.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86062025-01-09T01:41:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86072025-01-09T01:41:36.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082025-01-09T01:41:36.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
86092025-01-09T01:41:36.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86102025-01-09T01:41:36.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86112025-01-09T01:41:36.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
86122025-01-09T01:41:36.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.53223ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
86132025-01-09T01:41:37.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 93b920a4-2b86-4800-bb53-e255dc7ebc5b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86142025-01-09T01:41:37.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 93b920a4-2b86-4800-bb53-e255dc7ebc5b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86152025-01-09T01:41:37.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 93b920a4-2b86-4800-bb53-e255dc7ebc5b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86162025-01-09T01:41:38.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 98bb7814-3960-483f-8dcb-19b9a21ce69e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86172025-01-09T01:41:38.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 98bb7814-3960-483f-8dcb-19b9a21ce69e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86182025-01-09T01:41:38.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 98bb7814-3960-483f-8dcb-19b9a21ce69e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86192025-01-09T01:41:39.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 2fd10ce5-2eae-4f62-b8b9-d00add07692e response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
86202025-01-09T01:41:39.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4b8109ed-a930-4836-89ce-0673c6eb053c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86212025-01-09T01:41:39.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4b8109ed-a930-4836-89ce-0673c6eb053c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86222025-01-09T01:41:39.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4b8109ed-a930-4836-89ce-0673c6eb053c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86232025-01-09T01:41:40.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c756a085-9707-475c-8d31-1664e209eb61 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86242025-01-09T01:41:40.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c756a085-9707-475c-8d31-1664e209eb61 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86252025-01-09T01:41:40.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c756a085-9707-475c-8d31-1664e209eb61 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86262025-01-09T01:41:41.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e7f9ee71-aa96-41b0-8d5b-faf2aca3f932 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86272025-01-09T01:41:41.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e7f9ee71-aa96-41b0-8d5b-faf2aca3f932 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86282025-01-09T01:41:41.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e7f9ee71-aa96-41b0-8d5b-faf2aca3f932 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86292025-01-09T01:41:42.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e43c0ced-634b-4136-8260-d24f9ac9a6ec roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86302025-01-09T01:41:42.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e43c0ced-634b-4136-8260-d24f9ac9a6ec resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86312025-01-09T01:41:42.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e43c0ced-634b-4136-8260-d24f9ac9a6ec response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86322025-01-09T01:41:43.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79a924fe-b51c-4802-a8e9-c38dc9c49546 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86332025-01-09T01:41:43.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79a924fe-b51c-4802-a8e9-c38dc9c49546 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86342025-01-09T01:41:43.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79a924fe-b51c-4802-a8e9-c38dc9c49546 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86352025-01-09T01:41:44.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06eba64e-4b34-45f7-926e-c7f238727e41 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86362025-01-09T01:41:44.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06eba64e-4b34-45f7-926e-c7f238727e41 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86372025-01-09T01:41:44.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 06eba64e-4b34-45f7-926e-c7f238727e41 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86382025-01-09T01:41:45.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73b99930-b142-491b-b88b-a00ae799244b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86392025-01-09T01:41:45.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73b99930-b142-491b-b88b-a00ae799244b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86402025-01-09T01:41:45.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73b99930-b142-491b-b88b-a00ae799244b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86412025-01-09T01:41:46.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 37453827-4c6e-4e94-b0d2-cadf0a9473fb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86422025-01-09T01:41:46.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 37453827-4c6e-4e94-b0d2-cadf0a9473fb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86432025-01-09T01:41:46.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 37453827-4c6e-4e94-b0d2-cadf0a9473fb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
86442025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
86452025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
86462025-01-09T01:41:46.605ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
86472025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
86482025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.42\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
86492025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
86502025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
86512025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86522025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
86532025-01-09T01:41:46.605ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:31:46.605582138 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86542025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
86552025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86562025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86572025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
86582025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86592025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86602025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86612025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
86622025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
86632025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86642025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
86652025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
86662025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86672025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
86682025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86692025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
86702025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86712025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
86722025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86732025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
86742025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86752025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
86762025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
86772025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86782025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86792025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
86802025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
86812025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
86822025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86832025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86842025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
86852025-01-09T01:41:46.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86862025-01-09T01:41:46.605ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86872025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
86882025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86892025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86902025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86912025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
86922025-01-09T01:41:46.606ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86932025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86942025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86952025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86962025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86972025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86982025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86992025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87002025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87012025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87022025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87032025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87042025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87052025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87062025-01-09T01:41:46.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 5626931 } })
87072025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87082025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87092025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87102025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87112025-01-09T01:41:46.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 5679282 } })
87122025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87132025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87142025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
87152025-01-09T01:41:46.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.20204ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
87162025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
87172025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.316771ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
87182025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87192025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87202025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
87212025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87222025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
87232025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87242025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
87252025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87262025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
87272025-01-09T01:41:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87282025-01-09T01:41:46.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87292025-01-09T01:41:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87302025-01-09T01:41:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87312025-01-09T01:41:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87322025-01-09T01:41:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87332025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.678269ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87342025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
87352025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87362025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
87372025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87382025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87392025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87402025-01-09T01:41:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87412025-01-09T01:41:46.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 8772722 } })
87422025-01-09T01:41:46.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
87432025-01-09T01:41:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87442025-01-09T01:41:46.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87452025-01-09T01:41:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87462025-01-09T01:41:46.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87472025-01-09T01:41:46.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87482025-01-09T01:41:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87492025-01-09T01:41:46.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 12548063 } })
87502025-01-09T01:41:46.613ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:31:46.605582138 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87512025-01-09T01:41:46.613ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.891467ms iteration = 9 status = {"expiration":"2025-01-09T01:31:46.605582138Z","pruned":[]}
87522025-01-09T01:41:46.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
87532025-01-09T01:41:46.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87542025-01-09T01:41:46.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87552025-01-09T01:41:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87562025-01-09T01:41:46.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87572025-01-09T01:41:46.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87582025-01-09T01:41:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87592025-01-09T01:41:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87602025-01-09T01:41:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87612025-01-09T01:41:46.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87622025-01-09T01:41:46.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87632025-01-09T01:41:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87642025-01-09T01:41:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87652025-01-09T01:41:46.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87662025-01-09T01:41:46.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87672025-01-09T01:41:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87682025-01-09T01:41:46.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87692025-01-09T01:41:46.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87702025-01-09T01:41:46.619ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87712025-01-09T01:41:46.619ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87722025-01-09T01:41:46.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87732025-01-09T01:41:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87742025-01-09T01:41:46.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87752025-01-09T01:41:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87762025-01-09T01:41:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87772025-01-09T01:41:46.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87782025-01-09T01:41:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87792025-01-09T01:41:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87802025-01-09T01:41:46.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87812025-01-09T01:41:46.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87822025-01-09T01:41:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87832025-01-09T01:41:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87842025-01-09T01:41:46.622ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87852025-01-09T01:41:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87862025-01-09T01:41:46.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87872025-01-09T01:41:46.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.499739ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
87882025-01-09T01:41:46.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87892025-01-09T01:41:46.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87902025-01-09T01:41:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87912025-01-09T01:41:46.625ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.218027ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
87922025-01-09T01:41:46.625ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
87932025-01-09T01:41:46.625ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
87942025-01-09T01:41:46.625ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.829867ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
87952025-01-09T01:41:46.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87962025-01-09T01:41:46.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.550329ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
87972025-01-09T01:41:46.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87982025-01-09T01:41:46.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87992025-01-09T01:41:46.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88002025-01-09T01:41:46.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88012025-01-09T01:41:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88022025-01-09T01:41:46.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88032025-01-09T01:41:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88042025-01-09T01:41:46.631ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 30865627 } })
88052025-01-09T01:41:46.631ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
88062025-01-09T01:41:46.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88072025-01-09T01:41:46.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88082025-01-09T01:41:46.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88092025-01-09T01:41:46.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88102025-01-09T01:41:46.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88112025-01-09T01:41:46.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88122025-01-09T01:41:46.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88132025-01-09T01:41:46.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88142025-01-09T01:41:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88152025-01-09T01:41:46.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88162025-01-09T01:41:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88172025-01-09T01:41:46.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.748223ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88182025-01-09T01:41:46.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88192025-01-09T01:41:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88202025-01-09T01:41:46.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.59058ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88212025-01-09T01:41:46.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88222025-01-09T01:41:46.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88232025-01-09T01:41:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88242025-01-09T01:41:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88252025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88262025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88272025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88282025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88292025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88302025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88312025-01-09T01:41:46.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88322025-01-09T01:41:46.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.580235ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88332025-01-09T01:41:46.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88342025-01-09T01:41:46.695ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88352025-01-09T01:41:46.695ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88362025-01-09T01:41:46.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88372025-01-09T01:41:46.695ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88382025-01-09T01:41:46.695ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88392025-01-09T01:41:46.695ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.636752ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88402025-01-09T01:41:46.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88412025-01-09T01:41:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
88422025-01-09T01:41:46.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88432025-01-09T01:41:46.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88442025-01-09T01:41:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88452025-01-09T01:41:46.697ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88462025-01-09T01:41:46.697ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88472025-01-09T01:41:46.697ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88482025-01-09T01:41:46.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88492025-01-09T01:41:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88502025-01-09T01:41:46.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88512025-01-09T01:41:46.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88522025-01-09T01:41:46.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88532025-01-09T01:41:46.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88542025-01-09T01:41:46.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88552025-01-09T01:41:46.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88562025-01-09T01:41:46.702ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88572025-01-09T01:41:46.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.528503ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88582025-01-09T01:41:46.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88592025-01-09T01:41:46.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88602025-01-09T01:41:46.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88612025-01-09T01:41:46.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88622025-01-09T01:41:46.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88632025-01-09T01:41:46.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88642025-01-09T01:41:46.705ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88652025-01-09T01:41:46.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88662025-01-09T01:41:46.706ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88672025-01-09T01:41:46.706ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
88682025-01-09T01:41:46.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88692025-01-09T01:41:46.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
88702025-01-09T01:41:46.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88712025-01-09T01:41:46.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88722025-01-09T01:41:46.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88732025-01-09T01:41:46.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88742025-01-09T01:41:46.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88752025-01-09T01:41:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88762025-01-09T01:41:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88772025-01-09T01:41:46.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88782025-01-09T01:41:46.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88792025-01-09T01:41:46.726ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.433117ms iteration = 17 status = 0
88802025-01-09T01:41:46.735ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
88812025-01-09T01:41:46.735ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.524023ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
88822025-01-09T01:41:46.749ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88832025-01-09T01:41:46.749ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88842025-01-09T01:41:46.749ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.019627ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88852025-01-09T01:41:46.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.840164ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88862025-01-09T01:41:46.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88872025-01-09T01:41:46.762ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
88882025-01-09T01:41:46.762ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
88892025-01-09T01:41:46.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88902025-01-09T01:41:46.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88912025-01-09T01:41:46.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88922025-01-09T01:41:46.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88932025-01-09T01:41:46.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88942025-01-09T01:41:46.763ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88952025-01-09T01:41:46.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88962025-01-09T01:41:46.763ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff94f9e9-65f7-4adc-ad7e-e6fbfb091edc", "content-length": "26", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
88972025-01-09T01:41:46.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88982025-01-09T01:41:46.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88992025-01-09T01:41:46.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89002025-01-09T01:41:46.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89012025-01-09T01:41:46.766ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
89022025-01-09T01:41:46.766ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89032025-01-09T01:41:46.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
89042025-01-09T01:41:46.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.95402ms iteration = 9 status = {"generation":2}
89052025-01-09T01:41:46.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89062025-01-09T01:41:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89072025-01-09T01:41:46.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89082025-01-09T01:41:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89092025-01-09T01:41:46.774ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
89102025-01-09T01:41:46.774ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 168.977588ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89112025-01-09T01:41:46.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89122025-01-09T01:41:46.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89132025-01-09T01:41:46.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142025-01-09T01:41:46.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89152025-01-09T01:41:46.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89162025-01-09T01:41:46.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89172025-01-09T01:41:46.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89182025-01-09T01:41:46.785ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
89192025-01-09T01:41:46.785ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89202025-01-09T01:41:46.785ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
89212025-01-09T01:41:46.785ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 179.990756ms iteration = 9 status = {"generation":1}
89222025-01-09T01:41:46.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89232025-01-09T01:41:46.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89242025-01-09T01:41:46.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89252025-01-09T01:41:46.804ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89262025-01-09T01:41:46.804ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.671686ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89272025-01-09T01:41:46.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
89282025-01-09T01:41:46.839ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89292025-01-09T01:41:46.839ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd2f225e-fb8a-4c94-ac32-ab11c1c55c89", "content-length": "26", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89302025-01-09T01:41:46.839ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89312025-01-09T01:41:46.841ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
89322025-01-09T01:41:46.853ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89332025-01-09T01:41:46.853ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89342025-01-09T01:41:46.853ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7c35319-bce4-449e-9c18-75a38ff2ca9d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89352025-01-09T01:41:46.853ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89362025-01-09T01:41:46.856ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89372025-01-09T01:41:46.864ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 258.949115ms iteration = 19 status = {"physical_disks_added":0}
89382025-01-09T01:41:46.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89392025-01-09T01:41:46.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89402025-01-09T01:41:47.120ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89412025-01-09T01:41:47.121ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "709c19f8-9e99-4d66-bc9a-604b38b1f0bc", "content-length": "691", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89422025-01-09T01:41:47.121ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
89432025-01-09T01:41:47.121ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
89442025-01-09T01:41:47.121ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
89452025-01-09T01:41:47.122ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 517.022836ms iteration = 17 status = {}
89462025-01-09T01:41:47.159ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 553.658736ms iteration = 17 status = {}
89472025-01-09T01:41:47.171ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89482025-01-09T01:41:47.172ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0714b33c-2fec-47f2-b4a8-3a5d6480924c", "content-length": "1", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89492025-01-09T01:41:47.173ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89502025-01-09T01:41:47.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89512025-01-09T01:41:47.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "60c8989e-94b5-4e34-bd0a-25e2d9413e76", "content-length": "372", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89522025-01-09T01:41:47.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89532025-01-09T01:41:47.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89542025-01-09T01:41:47.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89552025-01-09T01:41:47.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89562025-01-09T01:41:47.176ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 571.194938ms iteration = 17 status = null
89572025-01-09T01:41:47.218ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89582025-01-09T01:41:47.218ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89592025-01-09T01:41:47.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "82ba2984-dade-4e30-8dc1-93654a413e8b", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89602025-01-09T01:41:47.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89612025-01-09T01:41:47.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89622025-01-09T01:41:47.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89632025-01-09T01:41:47.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89642025-01-09T01:41:47.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89652025-01-09T01:41:47.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89662025-01-09T01:41:47.233ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89672025-01-09T01:41:47.233ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89682025-01-09T01:41:47.233ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e80c0d9d-1dd8-45e1-9f55-d6d8356526cd", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89692025-01-09T01:41:47.235ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 629.285112ms iteration = 17 status = {}
89702025-01-09T01:41:47.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89712025-01-09T01:41:47.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0847325a-a3e3-4137-8c77-ef56ceb591a3", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89722025-01-09T01:41:47.309ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89732025-01-09T01:41:47.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5c4a3e16-9f3e-4b87-90bc-8e9380b66aeb", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89742025-01-09T01:41:47.310ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89752025-01-09T01:41:47.311ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89762025-01-09T01:41:47.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 706.453654ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89772025-01-09T01:41:47.312ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89782025-01-09T01:41:47.431ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89792025-01-09T01:41:47.432ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b67c181f-f68c-4f9c-bdca-31daca903268", "date": "Thu, 09 Jan 2025 01:41:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89802025-01-09T01:41:47.432ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89812025-01-09T01:41:47.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ad80b507-4221-4e4a-bfc0-3bbaf5271be8", "date": "Thu, 09 Jan 2025 01:41:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89822025-01-09T01:41:47.434ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89832025-01-09T01:41:47.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "31430c6a-74b2-4171-a7e8-aa66d54d5f6a", "date": "Thu, 09 Jan 2025 01:41:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89842025-01-09T01:41:47.436ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89852025-01-09T01:41:47.438ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89862025-01-09T01:41:47.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 832.810856ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89872025-01-09T01:41:47.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89882025-01-09T01:41:47.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89892025-01-09T01:41:47.467ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
89902025-01-09T01:41:47.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89912025-01-09T01:41:47.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89922025-01-09T01:41:47.477ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89932025-01-09T01:41:47.477ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f560b3-4a18-4c08-b901-9ac996186eca", "content-length": "134", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
89942025-01-09T01:41:47.477ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89952025-01-09T01:41:47.477ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
89962025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89972025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89982025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89992025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90002025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90012025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90022025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90032025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90042025-01-09T01:41:47.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
90052025-01-09T01:41:47.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90062025-01-09T01:41:47.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90072025-01-09T01:41:47.481ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90082025-01-09T01:41:47.481ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ed6c0b5-c1e0-4a48-bb85-5334e0bb8750", "content-length": "2", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
90092025-01-09T01:41:47.481ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90102025-01-09T01:41:47.481ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4837b3a4-6aa4-49eb-a5f2-c0c3a889ae36", "content-length": "52", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
90112025-01-09T01:41:47.481ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
90122025-01-09T01:41:47.481ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90132025-01-09T01:41:47.593ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a47c5641-25c6-4c0f-82a1-d3bc0998057c", "date": "Thu, 09 Jan 2025 01:41:46 GMT"} })
90142025-01-09T01:41:47.593ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
90152025-01-09T01:41:47.593ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90162025-01-09T01:41:47.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0109cdc-e26b-4e76-b59a-fe3c99d6235c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90172025-01-09T01:41:47.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0109cdc-e26b-4e76-b59a-fe3c99d6235c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90182025-01-09T01:41:47.594ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6316f9c-c70c-446c-98ab-9c95932d852f", "content-length": "682", "date": "Thu, 09 Jan 2025 01:41:47 GMT"} })
90192025-01-09T01:41:47.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90202025-01-09T01:41:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90212025-01-09T01:41:47.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0109cdc-e26b-4e76-b59a-fe3c99d6235c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90222025-01-09T01:41:47.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90232025-01-09T01:41:47.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90242025-01-09T01:41:47.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90252025-01-09T01:41:47.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90262025-01-09T01:41:47.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90272025-01-09T01:41:47.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90282025-01-09T01:41:47.613ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.007270793s iteration = 17 status = {}
90292025-01-09T01:41:48.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = dfca0a5c-09a1-439f-adb4-e0c9938d18aa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
90302025-01-09T01:41:48.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = dfca0a5c-09a1-439f-adb4-e0c9938d18aa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
90312025-01-09T01:41:48.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = dfca0a5c-09a1-439f-adb4-e0c9938d18aa response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
90322025-01-09T01:41:48.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c16d4c8-f99a-48c7-abb0-53e83405e43b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90332025-01-09T01:41:48.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c16d4c8-f99a-48c7-abb0-53e83405e43b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90342025-01-09T01:41:48.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c16d4c8-f99a-48c7-abb0-53e83405e43b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90352025-01-09T01:41:49.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 7eabc68d-d522-4c66-9508-e27a019da38a response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
90362025-01-09T01:41:49.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 127572a4-6de7-4fe5-a785-08773f89b81c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90372025-01-09T01:41:49.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 127572a4-6de7-4fe5-a785-08773f89b81c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90382025-01-09T01:41:49.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 127572a4-6de7-4fe5-a785-08773f89b81c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90392025-01-09T01:41:50.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb231a1d-5451-4412-b24a-02dda66b8d0a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90402025-01-09T01:41:50.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb231a1d-5451-4412-b24a-02dda66b8d0a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90412025-01-09T01:41:50.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb231a1d-5451-4412-b24a-02dda66b8d0a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90422025-01-09T01:41:51.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36675e25-7225-400a-a954-cc2f5ecc7d0b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90432025-01-09T01:41:51.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36675e25-7225-400a-a954-cc2f5ecc7d0b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90442025-01-09T01:41:51.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36675e25-7225-400a-a954-cc2f5ecc7d0b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90452025-01-09T01:41:52.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53507cfd-9155-43ca-9584-cbdc41d06522 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90462025-01-09T01:41:52.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53507cfd-9155-43ca-9584-cbdc41d06522 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90472025-01-09T01:41:52.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 53507cfd-9155-43ca-9584-cbdc41d06522 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90482025-01-09T01:41:53.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c744061f-b608-4746-ac04-6e71e2d4fe0d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90492025-01-09T01:41:53.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c744061f-b608-4746-ac04-6e71e2d4fe0d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90502025-01-09T01:41:53.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c744061f-b608-4746-ac04-6e71e2d4fe0d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90512025-01-09T01:41:54.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b4703222-3971-42ba-a39d-8e9f2baf20cf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90522025-01-09T01:41:54.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b4703222-3971-42ba-a39d-8e9f2baf20cf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90532025-01-09T01:41:54.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b4703222-3971-42ba-a39d-8e9f2baf20cf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90542025-01-09T01:41:55.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6c4cb13-2ada-4b25-b992-cb3b43a5727a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90552025-01-09T01:41:55.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6c4cb13-2ada-4b25-b992-cb3b43a5727a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90562025-01-09T01:41:55.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6c4cb13-2ada-4b25-b992-cb3b43a5727a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90572025-01-09T01:41:56.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
90582025-01-09T01:41:56.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90592025-01-09T01:41:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90602025-01-09T01:41:56.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
90612025-01-09T01:41:56.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90622025-01-09T01:41:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90632025-01-09T01:41:56.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90642025-01-09T01:41:56.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90652025-01-09T01:41:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90662025-01-09T01:41:56.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90672025-01-09T01:41:56.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90682025-01-09T01:41:56.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90692025-01-09T01:41:56.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.696555ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90702025-01-09T01:41:56.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90712025-01-09T01:41:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90722025-01-09T01:41:56.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90732025-01-09T01:41:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
90742025-01-09T01:41:56.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90752025-01-09T01:41:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90762025-01-09T01:41:56.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
90772025-01-09T01:41:56.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.266706ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
90782025-01-09T01:41:56.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1a9f1ecd-fc51-4980-97c3-e5beb6cbe7f4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90792025-01-09T01:41:56.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1a9f1ecd-fc51-4980-97c3-e5beb6cbe7f4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90802025-01-09T01:41:56.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1a9f1ecd-fc51-4980-97c3-e5beb6cbe7f4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90812025-01-09T01:41:57.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c09be5b1-1b7e-4cd0-a32d-f3263e7647c2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90822025-01-09T01:41:57.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c09be5b1-1b7e-4cd0-a32d-f3263e7647c2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90832025-01-09T01:41:57.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c09be5b1-1b7e-4cd0-a32d-f3263e7647c2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90842025-01-09T01:41:58.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2809dacb-35de-4651-890a-427605d750cc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90852025-01-09T01:41:58.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2809dacb-35de-4651-890a-427605d750cc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90862025-01-09T01:41:58.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2809dacb-35de-4651-890a-427605d750cc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90872025-01-09T01:41:59.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 43f41308-8958-45b6-a5b3-5c40d6b32e2f response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
90882025-01-09T01:41:59.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb3ad685-52e9-404f-9f48-42011bdd69df roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90892025-01-09T01:41:59.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb3ad685-52e9-404f-9f48-42011bdd69df resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90902025-01-09T01:41:59.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cb3ad685-52e9-404f-9f48-42011bdd69df response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90912025-01-09T01:42:00.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d192da2-8d9f-4dda-91d7-5efc2464409a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90922025-01-09T01:42:00.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d192da2-8d9f-4dda-91d7-5efc2464409a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90932025-01-09T01:42:00.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2d192da2-8d9f-4dda-91d7-5efc2464409a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90942025-01-09T01:42:01.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2c00ca4c-bfc9-4219-b023-b9041ec0745c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90952025-01-09T01:42:01.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2c00ca4c-bfc9-4219-b023-b9041ec0745c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90962025-01-09T01:42:01.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2c00ca4c-bfc9-4219-b023-b9041ec0745c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90972025-01-09T01:42:02.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45cc4575-e078-4f1e-847f-794ba0453e4e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90982025-01-09T01:42:02.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45cc4575-e078-4f1e-847f-794ba0453e4e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
90992025-01-09T01:42:02.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45cc4575-e078-4f1e-847f-794ba0453e4e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91002025-01-09T01:42:03.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 70f6020e-a826-4d25-a222-1e6cd3df0fc4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91012025-01-09T01:42:03.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 70f6020e-a826-4d25-a222-1e6cd3df0fc4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91022025-01-09T01:42:03.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 70f6020e-a826-4d25-a222-1e6cd3df0fc4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91032025-01-09T01:42:04.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33e59be5-c93b-430c-b961-031ca8e661a0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91042025-01-09T01:42:04.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33e59be5-c93b-430c-b961-031ca8e661a0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91052025-01-09T01:42:04.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33e59be5-c93b-430c-b961-031ca8e661a0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91062025-01-09T01:42:05.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17dc8100-b7f1-4972-8a32-7e1a116602e4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91072025-01-09T01:42:05.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17dc8100-b7f1-4972-8a32-7e1a116602e4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91082025-01-09T01:42:05.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17dc8100-b7f1-4972-8a32-7e1a116602e4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91092025-01-09T01:42:06.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
91102025-01-09T01:42:06.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91112025-01-09T01:42:06.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91122025-01-09T01:42:06.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
91132025-01-09T01:42:06.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91142025-01-09T01:42:06.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91152025-01-09T01:42:06.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91162025-01-09T01:42:06.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91172025-01-09T01:42:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91182025-01-09T01:42:06.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.960893ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91192025-01-09T01:42:06.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91202025-01-09T01:42:06.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91212025-01-09T01:42:06.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91222025-01-09T01:42:06.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91232025-01-09T01:42:06.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91242025-01-09T01:42:06.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91252025-01-09T01:42:06.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
91262025-01-09T01:42:06.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91272025-01-09T01:42:06.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91282025-01-09T01:42:06.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
91292025-01-09T01:42:06.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.674445ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
91302025-01-09T01:42:07.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bbd3a1da-ee70-4ecf-a9d4-ed133f788f7d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91312025-01-09T01:42:07.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bbd3a1da-ee70-4ecf-a9d4-ed133f788f7d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91322025-01-09T01:42:07.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bbd3a1da-ee70-4ecf-a9d4-ed133f788f7d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91332025-01-09T01:42:08.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5d74084-7ac7-473e-8e1e-b02b4daf3928 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91342025-01-09T01:42:08.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5d74084-7ac7-473e-8e1e-b02b4daf3928 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91352025-01-09T01:42:08.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5d74084-7ac7-473e-8e1e-b02b4daf3928 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91362025-01-09T01:42:09.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ff9bab5c-8592-4fa5-ba35-e68e24f1cdfb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91372025-01-09T01:42:09.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ff9bab5c-8592-4fa5-ba35-e68e24f1cdfb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91382025-01-09T01:42:09.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ff9bab5c-8592-4fa5-ba35-e68e24f1cdfb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91392025-01-09T01:42:09.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 693 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = c0ef4853-0172-4b10-8b7f-6eab37bd3d69 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
91402025-01-09T01:42:10.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 231ad5ef-ec1e-457b-9ce1-0b8df789060d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91412025-01-09T01:42:10.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 231ad5ef-ec1e-457b-9ce1-0b8df789060d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91422025-01-09T01:42:10.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 231ad5ef-ec1e-457b-9ce1-0b8df789060d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91432025-01-09T01:42:11.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1a68b37-d580-4163-8099-f2eeaee9c74d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91442025-01-09T01:42:11.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1a68b37-d580-4163-8099-f2eeaee9c74d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91452025-01-09T01:42:11.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1a68b37-d580-4163-8099-f2eeaee9c74d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91462025-01-09T01:42:12.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4dd34ad2-d71e-490d-88ef-88b19bda6ef8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91472025-01-09T01:42:12.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4dd34ad2-d71e-490d-88ef-88b19bda6ef8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91482025-01-09T01:42:12.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4dd34ad2-d71e-490d-88ef-88b19bda6ef8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91492025-01-09T01:42:13.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c9bea66-33f9-4911-9d57-2fc87a1e196b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91502025-01-09T01:42:13.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c9bea66-33f9-4911-9d57-2fc87a1e196b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91512025-01-09T01:42:13.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1c9bea66-33f9-4911-9d57-2fc87a1e196b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91522025-01-09T01:42:14.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fa8fbfda-fc65-42ee-9d4a-442a6d3626b3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91532025-01-09T01:42:14.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fa8fbfda-fc65-42ee-9d4a-442a6d3626b3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91542025-01-09T01:42:14.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fa8fbfda-fc65-42ee-9d4a-442a6d3626b3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91552025-01-09T01:42:15.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 933c38fe-e6c7-4585-8867-35ec6ea67817 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91562025-01-09T01:42:15.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 933c38fe-e6c7-4585-8867-35ec6ea67817 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91572025-01-09T01:42:15.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 933c38fe-e6c7-4585-8867-35ec6ea67817 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91582025-01-09T01:42:16.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7f882f32-e043-44ef-8861-cbd1aee90ae9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91592025-01-09T01:42:16.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7f882f32-e043-44ef-8861-cbd1aee90ae9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91602025-01-09T01:42:16.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7f882f32-e043-44ef-8861-cbd1aee90ae9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
91612025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
91622025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
91632025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91642025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91652025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
91662025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91672025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
91682025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
91692025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
91702025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
91712025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91722025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91732025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91742025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
91752025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
91762025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91772025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91782025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
91792025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91802025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
91812025-01-09T01:42:16.606ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91822025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91832025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
91842025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91852025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
91862025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91872025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91882025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91892025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91902025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91912025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91922025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91932025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91942025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91952025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91962025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91972025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91982025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91992025-01-09T01:42:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92002025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92012025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92022025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92032025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92042025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92052025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92062025-01-09T01:42:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92072025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.037829ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92082025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
92092025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92102025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
92112025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92122025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92132025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92142025-01-09T01:42:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92152025-01-09T01:42:16.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1469, tv_nsec: 8432666 } })
92162025-01-09T01:42:16.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92172025-01-09T01:42:16.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1469, tv_nsec: 9352571 } })
92182025-01-09T01:42:16.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92192025-01-09T01:42:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92202025-01-09T01:42:16.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92212025-01-09T01:42:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92222025-01-09T01:42:16.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92232025-01-09T01:42:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92242025-01-09T01:42:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92252025-01-09T01:42:16.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92262025-01-09T01:42:16.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92272025-01-09T01:42:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92282025-01-09T01:42:16.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92292025-01-09T01:42:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92302025-01-09T01:42:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92312025-01-09T01:42:16.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92322025-01-09T01:42:16.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332025-01-09T01:42:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92342025-01-09T01:42:16.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92352025-01-09T01:42:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92362025-01-09T01:42:16.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92372025-01-09T01:42:16.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.176923ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
92382025-01-09T01:42:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92392025-01-09T01:42:16.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92402025-01-09T01:42:16.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92412025-01-09T01:42:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92422025-01-09T01:42:16.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92432025-01-09T01:42:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92442025-01-09T01:42:16.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1469, tv_nsec: 21494236 } })
92452025-01-09T01:42:16.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
92462025-01-09T01:42:16.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.79128ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92472025-01-09T01:42:16.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92482025-01-09T01:42:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92492025-01-09T01:42:16.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92502025-01-09T01:42:16.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92512025-01-09T01:42:16.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92522025-01-09T01:42:16.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.177634ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92532025-01-09T01:42:16.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
92542025-01-09T01:42:16.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92552025-01-09T01:42:16.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92562025-01-09T01:42:16.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92572025-01-09T01:42:16.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92582025-01-09T01:42:16.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92592025-01-09T01:42:16.639ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
92602025-01-09T01:42:16.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.780494ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
92612025-01-09T01:42:16.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92622025-01-09T01:42:16.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92632025-01-09T01:42:16.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642025-01-09T01:42:16.643ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92652025-01-09T01:42:16.643ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92662025-01-09T01:42:16.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92672025-01-09T01:42:16.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.536404ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92682025-01-09T01:42:16.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92692025-01-09T01:42:16.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92702025-01-09T01:42:16.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92712025-01-09T01:42:16.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92722025-01-09T01:42:16.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92732025-01-09T01:42:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92742025-01-09T01:42:16.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.017878ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
92752025-01-09T01:42:16.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92762025-01-09T01:42:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92772025-01-09T01:42:16.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92782025-01-09T01:42:16.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92792025-01-09T01:42:16.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92802025-01-09T01:42:16.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92812025-01-09T01:42:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92822025-01-09T01:42:16.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 43.456409ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
92832025-01-09T01:42:16.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92842025-01-09T01:42:16.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92852025-01-09T01:42:16.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92862025-01-09T01:42:16.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92872025-01-09T01:42:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92882025-01-09T01:42:16.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92892025-01-09T01:42:16.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92902025-01-09T01:42:16.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92912025-01-09T01:42:16.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92922025-01-09T01:42:16.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92932025-01-09T01:42:16.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92942025-01-09T01:42:16.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92952025-01-09T01:42:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92962025-01-09T01:42:16.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92972025-01-09T01:42:16.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92982025-01-09T01:42:16.680ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92992025-01-09T01:42:16.680ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93002025-01-09T01:42:16.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93012025-01-09T01:42:16.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93022025-01-09T01:42:16.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93032025-01-09T01:42:16.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93042025-01-09T01:42:16.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.730802ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93052025-01-09T01:42:16.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93062025-01-09T01:42:16.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
93072025-01-09T01:42:16.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93082025-01-09T01:42:16.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93092025-01-09T01:42:16.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93102025-01-09T01:42:16.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93112025-01-09T01:42:16.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.457135ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93122025-01-09T01:42:16.783ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.17743ms iteration = 20 status = {"physical_disks_added":0}
93132025-01-09T01:42:16.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93142025-01-09T01:42:16.866ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93152025-01-09T01:42:16.866ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd0a73e9-f002-431e-942d-aaf55c816a48", "content-length": "26", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93162025-01-09T01:42:16.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93172025-01-09T01:42:16.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93182025-01-09T01:42:16.870ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93192025-01-09T01:42:16.870ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93202025-01-09T01:42:16.870ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa7afeab-48a8-47d1-9394-eef9aa4b61b7", "content-length": "26", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93212025-01-09T01:42:16.870ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93222025-01-09T01:42:16.872ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93232025-01-09T01:42:16.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
93242025-01-09T01:42:16.894ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93252025-01-09T01:42:16.894ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "785bc10d-2bed-4c59-b4a9-5fe3eb336064", "content-length": "26", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93262025-01-09T01:42:16.894ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93272025-01-09T01:42:16.896ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
93282025-01-09T01:42:16.961ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93292025-01-09T01:42:16.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93302025-01-09T01:42:16.961ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a05bd82d-b0a2-45a9-9e66-076488dde567", "content-length": "372", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93312025-01-09T01:42:16.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93322025-01-09T01:42:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93332025-01-09T01:42:16.963ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 357.594143ms iteration = 18 status = 0
93342025-01-09T01:42:17.015ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93352025-01-09T01:42:17.015ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93362025-01-09T01:42:17.015ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 409.364245ms iteration = 18 status = {}
93372025-01-09T01:42:17.015ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3378322d-7bea-45f2-9116-e54ddbc0019e", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93382025-01-09T01:42:17.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93392025-01-09T01:42:17.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93402025-01-09T01:42:17.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93412025-01-09T01:42:17.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c41a4609-290f-4f53-aa98-b24f175af4d5", "content-length": "691", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93422025-01-09T01:42:17.018ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93432025-01-09T01:42:17.018ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93442025-01-09T01:42:17.018ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93452025-01-09T01:42:17.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93462025-01-09T01:42:17.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93472025-01-09T01:42:17.019ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.472291ms iteration = 18 status = {}
93482025-01-09T01:42:17.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93492025-01-09T01:42:17.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93502025-01-09T01:42:17.025ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93512025-01-09T01:42:17.025ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93522025-01-09T01:42:17.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "afaf10c3-ab3b-4d1b-8a51-ad791b8462f3", "date": "Thu, 09 Jan 2025 01:42:17 GMT"} })
93532025-01-09T01:42:17.027ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 421.716743ms iteration = 18 status = {}
93542025-01-09T01:42:17.067ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93552025-01-09T01:42:17.067ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd4eb4c6-6066-49f7-8a6c-7f3f94305f72", "content-length": "1", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93562025-01-09T01:42:17.069ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93572025-01-09T01:42:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93582025-01-09T01:42:17.071ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 465.650951ms iteration = 18 status = null
93592025-01-09T01:42:17.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93602025-01-09T01:42:17.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93612025-01-09T01:42:17.140ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
93622025-01-09T01:42:17.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93632025-01-09T01:42:17.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93642025-01-09T01:42:17.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93652025-01-09T01:42:17.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "86b54e2a-3f50-48b6-9ff1-f8180a668f56", "content-length": "134", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93662025-01-09T01:42:17.149ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93672025-01-09T01:42:17.149ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
93682025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93692025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93702025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93712025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93722025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93732025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93742025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93752025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93762025-01-09T01:42:17.150ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
93772025-01-09T01:42:17.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93782025-01-09T01:42:17.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93792025-01-09T01:42:17.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93802025-01-09T01:42:17.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "58c84db8-b13b-4768-ab6e-1294ccd24192", "content-length": "2", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93812025-01-09T01:42:17.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93822025-01-09T01:42:17.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bee0eb4-47c8-4b49-b502-e29f9e016324", "content-length": "52", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93832025-01-09T01:42:17.153ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
93842025-01-09T01:42:17.153ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93852025-01-09T01:42:17.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5a537b1a-5d74-4837-bfbe-65cd7cc87010", "date": "Thu, 09 Jan 2025 01:42:16 GMT"} })
93862025-01-09T01:42:17.242ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
93872025-01-09T01:42:17.242ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93882025-01-09T01:42:17.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4de191f-01d8-4f7d-932c-8e5fc2d81947 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
93892025-01-09T01:42:17.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4de191f-01d8-4f7d-932c-8e5fc2d81947 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
93902025-01-09T01:42:17.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d85e6673-f694-443a-83f6-191d44fa3abf", "content-length": "682", "date": "Thu, 09 Jan 2025 01:42:17 GMT"} })
93912025-01-09T01:42:17.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93922025-01-09T01:42:17.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93932025-01-09T01:42:17.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4de191f-01d8-4f7d-932c-8e5fc2d81947 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
93942025-01-09T01:42:17.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93952025-01-09T01:42:17.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93962025-01-09T01:42:17.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93972025-01-09T01:42:17.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93982025-01-09T01:42:17.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93992025-01-09T01:42:17.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94002025-01-09T01:42:17.259ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 653.608844ms iteration = 18 status = {}
94012025-01-09T01:42:17.337ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94022025-01-09T01:42:17.337ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
94032025-01-09T01:42:17.367ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94042025-01-09T01:42:17.367ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39813
94052025-01-09T01:42:17.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39813 req_id = e8ba2814-ea7e-4726-b0fd-cb561b01b6c5 roles = RoleSet { roles: {} } uri = /metrics/producers
94062025-01-09T01:42:17.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39813 req_id = e8ba2814-ea7e-4726-b0fd-cb561b01b6c5 resource = Database result = Ok(()) uri = /metrics/producers
94072025-01-09T01:42:17.412ZINFOnexus: assigned collector to new producer collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:76 producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
94082025-01-09T01:42:17.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44411 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39813 req_id = e8ba2814-ea7e-4726-b0fd-cb561b01b6c5 response_code = 201 uri = /metrics/producers
94092025-01-09T01:42:17.412ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e8ba2814-ea7e-4726-b0fd-cb561b01b6c5", "content-length": "41", "date": "Thu, 09 Jan 2025 01:42:17 GMT"} })
94102025-01-09T01:42:17.413ZDEBGnexus (producer-registration-task): registered with nexus successfully
94112025-01-09T01:42:17.413ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94122025-01-09T01:42:18.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fee410f4-551a-44a0-a5f4-a1237912e661 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
94132025-01-09T01:42:18.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fee410f4-551a-44a0-a5f4-a1237912e661 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
94142025-01-09T01:42:18.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fee410f4-551a-44a0-a5f4-a1237912e661 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
94152025-01-09T01:42:18.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa43122e-c4cb-4fcb-b2ea-93fb7e39c71f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94162025-01-09T01:42:18.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa43122e-c4cb-4fcb-b2ea-93fb7e39c71f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94172025-01-09T01:42:18.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa43122e-c4cb-4fcb-b2ea-93fb7e39c71f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94182025-01-09T01:42:19.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73c2fa50-1fd1-4324-b6be-47f322ae6f2b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94192025-01-09T01:42:19.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73c2fa50-1fd1-4324-b6be-47f322ae6f2b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94202025-01-09T01:42:19.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73c2fa50-1fd1-4324-b6be-47f322ae6f2b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94212025-01-09T01:42:19.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 5a8ff945-4dea-4148-8e1b-d323d95a9e7a response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
94222025-01-09T01:42:20.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c227ec8-360b-4e44-8a9f-f53dae9681fa roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94232025-01-09T01:42:20.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c227ec8-360b-4e44-8a9f-f53dae9681fa resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94242025-01-09T01:42:20.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c227ec8-360b-4e44-8a9f-f53dae9681fa response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94252025-01-09T01:42:21.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 346ddf63-9e33-49bc-bba3-b75549db3677 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94262025-01-09T01:42:21.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 346ddf63-9e33-49bc-bba3-b75549db3677 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94272025-01-09T01:42:21.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 346ddf63-9e33-49bc-bba3-b75549db3677 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94282025-01-09T01:42:22.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 99e69221-bb0d-4a9c-a04c-d219d9a028fe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94292025-01-09T01:42:22.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 99e69221-bb0d-4a9c-a04c-d219d9a028fe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94302025-01-09T01:42:22.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 99e69221-bb0d-4a9c-a04c-d219d9a028fe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94312025-01-09T01:42:23.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d5102e1a-69e8-4a36-ac53-0ff5d832130b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94322025-01-09T01:42:23.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d5102e1a-69e8-4a36-ac53-0ff5d832130b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94332025-01-09T01:42:23.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d5102e1a-69e8-4a36-ac53-0ff5d832130b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94342025-01-09T01:42:24.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86814585-b6be-4cd4-9746-1c7b03f6a834 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94352025-01-09T01:42:24.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86814585-b6be-4cd4-9746-1c7b03f6a834 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94362025-01-09T01:42:24.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86814585-b6be-4cd4-9746-1c7b03f6a834 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94372025-01-09T01:42:25.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c2a2e89c-a536-4926-ac46-791083f9943d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94382025-01-09T01:42:25.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c2a2e89c-a536-4926-ac46-791083f9943d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94392025-01-09T01:42:25.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c2a2e89c-a536-4926-ac46-791083f9943d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94402025-01-09T01:42:26.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 43fe9001-3313-491a-9230-d45042ec6e1d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94412025-01-09T01:42:26.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 43fe9001-3313-491a-9230-d45042ec6e1d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94422025-01-09T01:42:26.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 43fe9001-3313-491a-9230-d45042ec6e1d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94432025-01-09T01:42:26.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
94442025-01-09T01:42:26.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94452025-01-09T01:42:26.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94462025-01-09T01:42:26.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
94472025-01-09T01:42:26.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94482025-01-09T01:42:26.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94492025-01-09T01:42:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94502025-01-09T01:42:26.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94512025-01-09T01:42:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94522025-01-09T01:42:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94532025-01-09T01:42:26.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94542025-01-09T01:42:26.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94552025-01-09T01:42:26.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94562025-01-09T01:42:26.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94572025-01-09T01:42:26.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94582025-01-09T01:42:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
94592025-01-09T01:42:26.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94602025-01-09T01:42:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94612025-01-09T01:42:26.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
94622025-01-09T01:42:26.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.246553ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
94632025-01-09T01:42:26.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.618923ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94642025-01-09T01:42:27.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d7109aa6-7ee3-4472-9ef3-27ab2c41da3c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94652025-01-09T01:42:27.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d7109aa6-7ee3-4472-9ef3-27ab2c41da3c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94662025-01-09T01:42:27.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d7109aa6-7ee3-4472-9ef3-27ab2c41da3c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94672025-01-09T01:42:28.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e094a0c-d152-4a3e-80a0-cb6180713303 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94682025-01-09T01:42:28.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e094a0c-d152-4a3e-80a0-cb6180713303 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94692025-01-09T01:42:28.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6e094a0c-d152-4a3e-80a0-cb6180713303 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94702025-01-09T01:42:29.291ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:45875
94712025-01-09T01:42:29.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 0c5a82cb-ed14-48e7-ad48-64aab582f306 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
94722025-01-09T01:42:29.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 0c5a82cb-ed14-48e7-ad48-64aab582f306 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
94732025-01-09T01:42:29.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 0c5a82cb-ed14-48e7-ad48-64aab582f306 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
94742025-01-09T01:42:29.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 78f7af57-f54a-4000-b84e-e3bb7ddbf320 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
94752025-01-09T01:42:29.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 78f7af57-f54a-4000-b84e-e3bb7ddbf320 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
94762025-01-09T01:42:29.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 78f7af57-f54a-4000-b84e-e3bb7ddbf320 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
94772025-01-09T01:42:29.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 4942dc2b-400c-4614-85d4-4b8f3023d8fc response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
94782025-01-09T01:42:29.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3b8d9f6-3dbd-4660-8130-1d0a5f94674e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94792025-01-09T01:42:29.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3b8d9f6-3dbd-4660-8130-1d0a5f94674e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94802025-01-09T01:42:29.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3b8d9f6-3dbd-4660-8130-1d0a5f94674e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94812025-01-09T01:42:30.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9ff73d8d-5a91-4c62-b31c-f4eaabccf16e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94822025-01-09T01:42:30.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9ff73d8d-5a91-4c62-b31c-f4eaabccf16e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94832025-01-09T01:42:30.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9ff73d8d-5a91-4c62-b31c-f4eaabccf16e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94842025-01-09T01:42:31.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8f60476b-91a5-4f36-841e-2f983147ecab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94852025-01-09T01:42:31.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8f60476b-91a5-4f36-841e-2f983147ecab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94862025-01-09T01:42:31.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8f60476b-91a5-4f36-841e-2f983147ecab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94872025-01-09T01:42:32.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b729e658-06ef-475e-834c-3f6e72c48380 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94882025-01-09T01:42:32.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b729e658-06ef-475e-834c-3f6e72c48380 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94892025-01-09T01:42:32.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b729e658-06ef-475e-834c-3f6e72c48380 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94902025-01-09T01:42:33.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9b2e490-abb5-442c-831e-73fd43adc502 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94912025-01-09T01:42:33.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9b2e490-abb5-442c-831e-73fd43adc502 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94922025-01-09T01:42:33.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9b2e490-abb5-442c-831e-73fd43adc502 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94932025-01-09T01:42:34.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5a8519e8-f72b-40d9-b5da-a10c2ae246d3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94942025-01-09T01:42:34.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5a8519e8-f72b-40d9-b5da-a10c2ae246d3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94952025-01-09T01:42:34.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5a8519e8-f72b-40d9-b5da-a10c2ae246d3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94962025-01-09T01:42:35.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ec71d49-741c-400a-bd3b-74a773bec4d0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94972025-01-09T01:42:35.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ec71d49-741c-400a-bd3b-74a773bec4d0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94982025-01-09T01:42:35.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6ec71d49-741c-400a-bd3b-74a773bec4d0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
94992025-01-09T01:42:36.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
95002025-01-09T01:42:36.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95012025-01-09T01:42:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95022025-01-09T01:42:36.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
95032025-01-09T01:42:36.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95042025-01-09T01:42:36.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95052025-01-09T01:42:36.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95062025-01-09T01:42:36.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95072025-01-09T01:42:36.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95082025-01-09T01:42:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95092025-01-09T01:42:36.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95102025-01-09T01:42:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95112025-01-09T01:42:36.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95122025-01-09T01:42:36.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
95132025-01-09T01:42:36.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95142025-01-09T01:42:36.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95152025-01-09T01:42:36.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
95162025-01-09T01:42:36.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.946299ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
95172025-01-09T01:42:36.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95182025-01-09T01:42:36.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95192025-01-09T01:42:36.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.466424ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95202025-01-09T01:42:36.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1998cc1-d4ad-45f6-95de-e9dda0c1269c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95212025-01-09T01:42:36.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1998cc1-d4ad-45f6-95de-e9dda0c1269c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95222025-01-09T01:42:36.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1998cc1-d4ad-45f6-95de-e9dda0c1269c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95232025-01-09T01:42:37.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a8d2654d-6bf9-4673-ab8d-43b271accbea roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95242025-01-09T01:42:37.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a8d2654d-6bf9-4673-ab8d-43b271accbea resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95252025-01-09T01:42:37.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a8d2654d-6bf9-4673-ab8d-43b271accbea response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95262025-01-09T01:42:38.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a43efb9-198a-4524-9325-c7ccd50b144f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95272025-01-09T01:42:38.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a43efb9-198a-4524-9325-c7ccd50b144f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95282025-01-09T01:42:38.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a43efb9-198a-4524-9325-c7ccd50b144f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95292025-01-09T01:42:39.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 923 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 2635584c-c482-43fc-88bd-ba6b3e7867f2 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
95302025-01-09T01:42:39.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d15bb01-f3a6-4b6d-8c30-fb0f276eb884 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95312025-01-09T01:42:39.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d15bb01-f3a6-4b6d-8c30-fb0f276eb884 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95322025-01-09T01:42:39.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d15bb01-f3a6-4b6d-8c30-fb0f276eb884 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95332025-01-09T01:42:40.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65fdcb34-a13e-4215-9d32-5eef4c88ee66 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95342025-01-09T01:42:40.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65fdcb34-a13e-4215-9d32-5eef4c88ee66 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95352025-01-09T01:42:40.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65fdcb34-a13e-4215-9d32-5eef4c88ee66 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95362025-01-09T01:42:41.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d3ae8e3-6d0a-4223-9773-b2b0fb317010 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95372025-01-09T01:42:41.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d3ae8e3-6d0a-4223-9773-b2b0fb317010 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95382025-01-09T01:42:41.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d3ae8e3-6d0a-4223-9773-b2b0fb317010 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95392025-01-09T01:42:42.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bea1ad83-1e2b-4153-8d0d-97a8e214490a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95402025-01-09T01:42:42.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bea1ad83-1e2b-4153-8d0d-97a8e214490a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95412025-01-09T01:42:42.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bea1ad83-1e2b-4153-8d0d-97a8e214490a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95422025-01-09T01:42:43.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d8635d6-69ba-4ccf-b892-f0eefa617d38 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95432025-01-09T01:42:43.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d8635d6-69ba-4ccf-b892-f0eefa617d38 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95442025-01-09T01:42:43.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d8635d6-69ba-4ccf-b892-f0eefa617d38 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95452025-01-09T01:42:44.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eca811a9-4005-442e-8b99-db0b1e85d034 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95462025-01-09T01:42:44.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eca811a9-4005-442e-8b99-db0b1e85d034 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95472025-01-09T01:42:44.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eca811a9-4005-442e-8b99-db0b1e85d034 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95482025-01-09T01:42:45.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 92892cec-81eb-4632-9238-d308f63264ff roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95492025-01-09T01:42:45.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 92892cec-81eb-4632-9238-d308f63264ff resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95502025-01-09T01:42:45.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 92892cec-81eb-4632-9238-d308f63264ff response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
95512025-01-09T01:42:46.605ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
95522025-01-09T01:42:46.605ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
95532025-01-09T01:42:46.605ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
95542025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
95552025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.781\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
95562025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
95572025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
95582025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95592025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
95602025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95612025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95622025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
95632025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
95642025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95652025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
95662025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95672025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
95682025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95692025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
95702025-01-09T01:42:46.606ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:32:46.606080484 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95712025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
95722025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95732025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95742025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95752025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
95762025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95772025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95782025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95792025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95802025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95812025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95822025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
95832025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
95842025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95852025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
95862025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95872025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
95882025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95892025-01-09T01:42:46.606ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95902025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
95912025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95922025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95932025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95942025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
95952025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95962025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
95972025-01-09T01:42:46.606ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95982025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95992025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
96002025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96012025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96022025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96032025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96042025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
96052025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
96062025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96072025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
96082025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96092025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96102025-01-09T01:42:46.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 5206344 } })
96112025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96122025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96132025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96142025-01-09T01:42:46.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96152025-01-09T01:42:46.606ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 5383867 } })
96162025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96172025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96182025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96192025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96202025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96212025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96222025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96232025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96242025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96252025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
96262025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.21686ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
96272025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96282025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96292025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
96302025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.29466ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
96312025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96322025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96332025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96342025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96352025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96362025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372025-01-09T01:42:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96382025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96392025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96402025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96412025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96422025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
96432025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96442025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96452025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96462025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96472025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96482025-01-09T01:42:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96492025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96502025-01-09T01:42:46.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 7595213 } })
96512025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96522025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96532025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96542025-01-09T01:42:46.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96552025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.940284ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96562025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
96572025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96582025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
96592025-01-09T01:42:46.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96602025-01-09T01:42:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96612025-01-09T01:42:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96622025-01-09T01:42:46.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 8762812 } })
96632025-01-09T01:42:46.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96642025-01-09T01:42:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96652025-01-09T01:42:46.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96662025-01-09T01:42:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96672025-01-09T01:42:46.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96682025-01-09T01:42:46.613ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:32:46.606080484 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96692025-01-09T01:42:46.613ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.320568ms iteration = 10 status = {"expiration":"2025-01-09T01:32:46.606080484Z","pruned":[]}
96702025-01-09T01:42:46.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96712025-01-09T01:42:46.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96722025-01-09T01:42:46.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96732025-01-09T01:42:46.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96742025-01-09T01:42:46.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96752025-01-09T01:42:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96762025-01-09T01:42:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96772025-01-09T01:42:46.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96782025-01-09T01:42:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96792025-01-09T01:42:46.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96802025-01-09T01:42:46.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96812025-01-09T01:42:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96822025-01-09T01:42:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96832025-01-09T01:42:46.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96842025-01-09T01:42:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96852025-01-09T01:42:46.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96862025-01-09T01:42:46.619ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96872025-01-09T01:42:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96882025-01-09T01:42:46.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96892025-01-09T01:42:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96902025-01-09T01:42:46.622ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96912025-01-09T01:42:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96922025-01-09T01:42:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96932025-01-09T01:42:46.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96942025-01-09T01:42:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96952025-01-09T01:42:46.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96962025-01-09T01:42:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96972025-01-09T01:42:46.635ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.363715ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
96982025-01-09T01:42:46.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96992025-01-09T01:42:46.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97002025-01-09T01:42:46.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97012025-01-09T01:42:46.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97022025-01-09T01:42:46.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97032025-01-09T01:42:46.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97042025-01-09T01:42:46.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97052025-01-09T01:42:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97062025-01-09T01:42:46.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97072025-01-09T01:42:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97082025-01-09T01:42:46.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97092025-01-09T01:42:46.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97102025-01-09T01:42:46.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97112025-01-09T01:42:46.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 67931513 } })
97122025-01-09T01:42:46.669ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
97132025-01-09T01:42:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97142025-01-09T01:42:46.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97152025-01-09T01:42:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97162025-01-09T01:42:46.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97172025-01-09T01:42:46.676ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97182025-01-09T01:42:46.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97192025-01-09T01:42:46.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.275271ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
97202025-01-09T01:42:46.679ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212025-01-09T01:42:46.679ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97222025-01-09T01:42:46.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97232025-01-09T01:42:46.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97242025-01-09T01:42:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97252025-01-09T01:42:46.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97262025-01-09T01:42:46.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.732963ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
97272025-01-09T01:42:46.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97282025-01-09T01:42:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97292025-01-09T01:42:46.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97302025-01-09T01:42:46.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97312025-01-09T01:42:46.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97322025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97332025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97342025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97352025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97362025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97372025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97382025-01-09T01:42:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97392025-01-09T01:42:46.688ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97402025-01-09T01:42:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97412025-01-09T01:42:46.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97422025-01-09T01:42:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97432025-01-09T01:42:46.689ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97442025-01-09T01:42:46.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97452025-01-09T01:42:46.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97462025-01-09T01:42:46.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97472025-01-09T01:42:46.690ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482025-01-09T01:42:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97492025-01-09T01:42:46.692ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97502025-01-09T01:42:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97512025-01-09T01:42:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97522025-01-09T01:42:46.692ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97532025-01-09T01:42:46.692ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97542025-01-09T01:42:46.692ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.976381ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97552025-01-09T01:42:46.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97562025-01-09T01:42:46.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97572025-01-09T01:42:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97582025-01-09T01:42:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
97592025-01-09T01:42:46.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97602025-01-09T01:42:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97612025-01-09T01:42:46.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.23768ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97622025-01-09T01:42:46.705ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 98.83384ms iteration = 5 status = {"nsuccess":5}
97632025-01-09T01:42:46.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97642025-01-09T01:42:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97652025-01-09T01:42:46.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97662025-01-09T01:42:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97672025-01-09T01:42:46.714ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97682025-01-09T01:42:46.715ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97692025-01-09T01:42:46.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97702025-01-09T01:42:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97712025-01-09T01:42:46.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97722025-01-09T01:42:46.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97732025-01-09T01:42:46.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.110139ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97742025-01-09T01:42:46.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
97752025-01-09T01:42:46.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 141.057409ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
97762025-01-09T01:42:46.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97772025-01-09T01:42:46.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97782025-01-09T01:42:46.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 154.81595ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97792025-01-09T01:42:46.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97802025-01-09T01:42:46.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97812025-01-09T01:42:46.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97822025-01-09T01:42:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97832025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
97842025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
97852025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
97862025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97872025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97882025-01-09T01:42:46.766ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97892025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 159.552687ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97902025-01-09T01:42:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97912025-01-09T01:42:46.771ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
97922025-01-09T01:42:46.777ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97932025-01-09T01:42:46.777ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97942025-01-09T01:42:46.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 170.867609ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97952025-01-09T01:42:46.777ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97962025-01-09T01:42:46.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.88292ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97972025-01-09T01:42:46.779ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97982025-01-09T01:42:46.779ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97992025-01-09T01:42:46.779ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98002025-01-09T01:42:46.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98012025-01-09T01:42:46.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98022025-01-09T01:42:46.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032025-01-09T01:42:46.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98042025-01-09T01:42:46.785ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98052025-01-09T01:42:46.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98062025-01-09T01:42:46.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
98072025-01-09T01:42:46.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98082025-01-09T01:42:46.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98092025-01-09T01:42:46.786ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98102025-01-09T01:42:46.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98112025-01-09T01:42:46.789ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98122025-01-09T01:42:46.789ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.820481ms iteration = 19 status = 0
98132025-01-09T01:42:46.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98142025-01-09T01:42:46.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98152025-01-09T01:42:46.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98162025-01-09T01:42:46.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98172025-01-09T01:42:46.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98182025-01-09T01:42:46.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98192025-01-09T01:42:46.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98202025-01-09T01:42:46.809ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98212025-01-09T01:42:46.809ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98222025-01-09T01:42:46.810ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8083957f-ae00-49e2-948e-18acfd141be8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
98232025-01-09T01:42:46.810ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98242025-01-09T01:42:46.812ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98252025-01-09T01:42:46.814ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98262025-01-09T01:42:46.814ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98272025-01-09T01:42:46.814ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2bf102b-6666-4ae3-a6bd-12dd528e6913", "content-length": "26", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
98282025-01-09T01:42:46.814ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98292025-01-09T01:42:46.816ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98302025-01-09T01:42:46.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98312025-01-09T01:42:46.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 213.147629ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98322025-01-09T01:42:46.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98332025-01-09T01:42:46.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98342025-01-09T01:42:46.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98352025-01-09T01:42:46.837ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98362025-01-09T01:42:46.837ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
98372025-01-09T01:42:46.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98382025-01-09T01:42:46.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98392025-01-09T01:42:46.852ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
98402025-01-09T01:42:46.852ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 246.862101ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98412025-01-09T01:42:46.873ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 266.398705ms iteration = 21 status = {"physical_disks_added":0}
98422025-01-09T01:42:46.886ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98432025-01-09T01:42:46.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 279.395905ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98442025-01-09T01:42:46.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 96b095a3-bab8-4831-97c3-242b63a74002 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
98452025-01-09T01:42:46.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 96b095a3-bab8-4831-97c3-242b63a74002 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
98462025-01-09T01:42:46.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98472025-01-09T01:42:46.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98482025-01-09T01:42:46.975ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98492025-01-09T01:42:46.975ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98502025-01-09T01:42:46.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6245cf65-e163-4c1c-8066-c736ca78d79c", "content-length": "372", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
98512025-01-09T01:42:46.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98522025-01-09T01:42:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98532025-01-09T01:42:46.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98542025-01-09T01:42:46.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 96b095a3-bab8-4831-97c3-242b63a74002 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
98552025-01-09T01:42:46.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98562025-01-09T01:42:46.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98572025-01-09T01:42:46.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98582025-01-09T01:42:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98592025-01-09T01:42:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98602025-01-09T01:42:46.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98612025-01-09T01:42:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98622025-01-09T01:42:46.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98632025-01-09T01:42:46.987ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
98642025-01-09T01:42:46.987ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98652025-01-09T01:42:46.987ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
98662025-01-09T01:42:46.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 381.464156ms iteration = 10 status = {"generation":2}
98672025-01-09T01:42:46.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98682025-01-09T01:42:46.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98692025-01-09T01:42:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98702025-01-09T01:42:46.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
98712025-01-09T01:42:46.998ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98722025-01-09T01:42:46.998ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc599752-4104-4345-a1af-746eb83711f5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
98732025-01-09T01:42:46.998ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98742025-01-09T01:42:47.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
98752025-01-09T01:42:47.032ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98762025-01-09T01:42:47.032ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98772025-01-09T01:42:47.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98782025-01-09T01:42:47.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98792025-01-09T01:42:47.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98802025-01-09T01:42:47.035ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
98812025-01-09T01:42:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98822025-01-09T01:42:47.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98832025-01-09T01:42:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98842025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98852025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98862025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
98872025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 435.093659ms iteration = 10 status = {"generation":1}
98882025-01-09T01:42:47.041ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
98892025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98902025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2256be43-14ec-4522-bce8-af3625013997", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
98912025-01-09T01:42:47.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98922025-01-09T01:42:47.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98932025-01-09T01:42:47.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98942025-01-09T01:42:47.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98952025-01-09T01:42:47.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98962025-01-09T01:42:47.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98972025-01-09T01:42:47.059ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98982025-01-09T01:42:47.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e25eebf8-78fc-4089-8238-2a3bdbc64794", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
98992025-01-09T01:42:47.059ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99002025-01-09T01:42:47.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6f4065d3-5220-4e27-b83d-f86482f0881f", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99012025-01-09T01:42:47.062ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99022025-01-09T01:42:47.063ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
99032025-01-09T01:42:47.064ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 458.098629ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99042025-01-09T01:42:47.065ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99052025-01-09T01:42:47.065ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a6fa4df-c5eb-4ec6-a081-49f6cc925837", "content-length": "1", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99062025-01-09T01:42:47.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99072025-01-09T01:42:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99082025-01-09T01:42:47.097ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 491.778501ms iteration = 19 status = {}
99092025-01-09T01:42:47.127ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99102025-01-09T01:42:47.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "81857c56-dd7a-48e1-9077-a8787c1aa72f", "content-length": "691", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99112025-01-09T01:42:47.128ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99122025-01-09T01:42:47.128ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99132025-01-09T01:42:47.128ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99142025-01-09T01:42:47.130ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 524.095511ms iteration = 19 status = null
99152025-01-09T01:42:47.130ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 523.802076ms iteration = 19 status = {}
99162025-01-09T01:42:47.131ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99172025-01-09T01:42:47.131ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99182025-01-09T01:42:47.131ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "93efc60a-a1f7-4203-b1d7-1b1cdd2ba1b9", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99192025-01-09T01:42:47.133ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 526.57625ms iteration = 19 status = {}
99202025-01-09T01:42:47.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99212025-01-09T01:42:47.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e3b96d8f-2539-4353-ba56-9f5648d856ab", "date": "Thu, 09 Jan 2025 01:42:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99222025-01-09T01:42:47.138ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99232025-01-09T01:42:47.140ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f4d62f91-144e-4ede-b0e1-7fad0f651f2e", "date": "Thu, 09 Jan 2025 01:42:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99242025-01-09T01:42:47.140ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99252025-01-09T01:42:47.142ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0fd0cb75-ddfd-4e62-af51-c0c6d6fd2679", "date": "Thu, 09 Jan 2025 01:42:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99262025-01-09T01:42:47.142ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99272025-01-09T01:42:47.144ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99282025-01-09T01:42:47.144ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 538.191307ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99292025-01-09T01:42:47.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99302025-01-09T01:42:47.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99312025-01-09T01:42:47.190ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
99322025-01-09T01:42:47.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99332025-01-09T01:42:47.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99342025-01-09T01:42:47.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99352025-01-09T01:42:47.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5056af5-8b3b-4fd9-b01c-d7e0bb0c230c", "content-length": "134", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99362025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99372025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
99382025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99392025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99402025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99412025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99422025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99432025-01-09T01:42:47.200ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99442025-01-09T01:42:47.201ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99452025-01-09T01:42:47.201ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99462025-01-09T01:42:47.201ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
99472025-01-09T01:42:47.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99482025-01-09T01:42:47.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99492025-01-09T01:42:47.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99502025-01-09T01:42:47.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "371c53bd-3dbd-4e0f-9f34-69b7d2d90d46", "content-length": "2", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99512025-01-09T01:42:47.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99522025-01-09T01:42:47.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5954f729-79d4-489a-b3ab-4d7a5273a64d", "content-length": "52", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99532025-01-09T01:42:47.204ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
99542025-01-09T01:42:47.204ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99552025-01-09T01:42:47.374ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "785ebec3-8cf2-4d6c-9956-b5ca06119744", "date": "Thu, 09 Jan 2025 01:42:46 GMT"} })
99562025-01-09T01:42:47.374ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
99572025-01-09T01:42:47.374ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99582025-01-09T01:42:47.374ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "416a81c4-ee91-41a9-893c-41d1234b36ad", "content-length": "682", "date": "Thu, 09 Jan 2025 01:42:47 GMT"} })
99592025-01-09T01:42:47.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99602025-01-09T01:42:47.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99612025-01-09T01:42:47.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99622025-01-09T01:42:47.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99632025-01-09T01:42:47.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99642025-01-09T01:42:47.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99652025-01-09T01:42:47.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99662025-01-09T01:42:47.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99672025-01-09T01:42:47.392ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 785.827941ms iteration = 19 status = {}
99682025-01-09T01:42:48.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0bb7fa49-0e5c-47d4-8551-5c41aa91d983 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99692025-01-09T01:42:48.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0bb7fa49-0e5c-47d4-8551-5c41aa91d983 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99702025-01-09T01:42:48.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0bb7fa49-0e5c-47d4-8551-5c41aa91d983 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99712025-01-09T01:42:48.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 8dd1ff72-890d-45d8-b462-b0e730d7a02b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
99722025-01-09T01:42:48.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 8dd1ff72-890d-45d8-b462-b0e730d7a02b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
99732025-01-09T01:42:48.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 8dd1ff72-890d-45d8-b462-b0e730d7a02b response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
99742025-01-09T01:42:49.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 498559dc-adff-4cad-af47-a24d222db461 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99752025-01-09T01:42:49.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 498559dc-adff-4cad-af47-a24d222db461 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99762025-01-09T01:42:49.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 498559dc-adff-4cad-af47-a24d222db461 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99772025-01-09T01:42:49.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = f6855165-ca31-4aa8-b0e8-9eded1d008ea response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
99782025-01-09T01:42:50.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa481075-c47b-406b-9376-71b1f918be1c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99792025-01-09T01:42:50.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa481075-c47b-406b-9376-71b1f918be1c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99802025-01-09T01:42:50.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa481075-c47b-406b-9376-71b1f918be1c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99812025-01-09T01:42:51.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 529d0f02-e1af-4789-a825-3403bd019b80 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99822025-01-09T01:42:51.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 529d0f02-e1af-4789-a825-3403bd019b80 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99832025-01-09T01:42:51.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 529d0f02-e1af-4789-a825-3403bd019b80 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99842025-01-09T01:42:52.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c67840e-4643-42a7-8f40-b7934aa4d6b7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99852025-01-09T01:42:52.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c67840e-4643-42a7-8f40-b7934aa4d6b7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99862025-01-09T01:42:52.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c67840e-4643-42a7-8f40-b7934aa4d6b7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99872025-01-09T01:42:53.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d746de4-4638-42b6-b5fe-7b80eaf39b01 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99882025-01-09T01:42:53.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d746de4-4638-42b6-b5fe-7b80eaf39b01 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99892025-01-09T01:42:53.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d746de4-4638-42b6-b5fe-7b80eaf39b01 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99902025-01-09T01:42:54.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 906b1f14-2300-4f33-be33-c9eafea0e69b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99912025-01-09T01:42:54.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 906b1f14-2300-4f33-be33-c9eafea0e69b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99922025-01-09T01:42:54.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 906b1f14-2300-4f33-be33-c9eafea0e69b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99932025-01-09T01:42:55.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5e112ea-4f86-446c-b072-8dbcd85bfb1a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99942025-01-09T01:42:55.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5e112ea-4f86-446c-b072-8dbcd85bfb1a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99952025-01-09T01:42:55.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5e112ea-4f86-446c-b072-8dbcd85bfb1a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99962025-01-09T01:42:56.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22c2eaba-fe07-40ac-a620-ae23fd0c7f5a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99972025-01-09T01:42:56.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22c2eaba-fe07-40ac-a620-ae23fd0c7f5a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99982025-01-09T01:42:56.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22c2eaba-fe07-40ac-a620-ae23fd0c7f5a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
99992025-01-09T01:42:56.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
100002025-01-09T01:42:56.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100012025-01-09T01:42:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100022025-01-09T01:42:56.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
100032025-01-09T01:42:56.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100042025-01-09T01:42:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100052025-01-09T01:42:56.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100062025-01-09T01:42:56.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100072025-01-09T01:42:56.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100082025-01-09T01:42:56.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100092025-01-09T01:42:56.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100102025-01-09T01:42:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100112025-01-09T01:42:56.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100122025-01-09T01:42:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
100132025-01-09T01:42:56.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100142025-01-09T01:42:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100152025-01-09T01:42:56.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
100162025-01-09T01:42:56.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.693695ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
100172025-01-09T01:42:56.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100182025-01-09T01:42:56.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100192025-01-09T01:42:56.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.355719ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100202025-01-09T01:42:57.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a6c5dbe4-93ab-4987-9457-1a2e0c416b8a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100212025-01-09T01:42:57.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a6c5dbe4-93ab-4987-9457-1a2e0c416b8a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100222025-01-09T01:42:57.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a6c5dbe4-93ab-4987-9457-1a2e0c416b8a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100232025-01-09T01:42:58.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eae3fa52-b136-44fb-a426-457ac77d7856 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100242025-01-09T01:42:58.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eae3fa52-b136-44fb-a426-457ac77d7856 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100252025-01-09T01:42:58.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eae3fa52-b136-44fb-a426-457ac77d7856 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100262025-01-09T01:42:59.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bcf5c921-85ef-4870-834a-3c8df37f3552 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100272025-01-09T01:42:59.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bcf5c921-85ef-4870-834a-3c8df37f3552 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100282025-01-09T01:42:59.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bcf5c921-85ef-4870-834a-3c8df37f3552 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100292025-01-09T01:42:59.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 747 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = bd0595b3-1406-4a4d-9a44-35e4f37d62de response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
100302025-01-09T01:43:00.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81b8f650-2afd-4e79-a1e8-f508f5c4c3fc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100312025-01-09T01:43:00.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81b8f650-2afd-4e79-a1e8-f508f5c4c3fc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100322025-01-09T01:43:00.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81b8f650-2afd-4e79-a1e8-f508f5c4c3fc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100332025-01-09T01:43:01.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a861781-0ccc-4d33-80d2-496ffb7abb5b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100342025-01-09T01:43:01.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a861781-0ccc-4d33-80d2-496ffb7abb5b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100352025-01-09T01:43:01.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a861781-0ccc-4d33-80d2-496ffb7abb5b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100362025-01-09T01:43:02.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2c3fd82d-e689-4c27-a1f0-915213384580 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100372025-01-09T01:43:02.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2c3fd82d-e689-4c27-a1f0-915213384580 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100382025-01-09T01:43:02.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2c3fd82d-e689-4c27-a1f0-915213384580 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100392025-01-09T01:43:03.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 268b298e-dfa2-4c38-b254-4170f08d3e1e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100402025-01-09T01:43:03.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 268b298e-dfa2-4c38-b254-4170f08d3e1e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100412025-01-09T01:43:03.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 268b298e-dfa2-4c38-b254-4170f08d3e1e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100422025-01-09T01:43:04.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6e76c84-c8ed-4c48-a8f9-4341085f91e7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100432025-01-09T01:43:04.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6e76c84-c8ed-4c48-a8f9-4341085f91e7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100442025-01-09T01:43:04.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d6e76c84-c8ed-4c48-a8f9-4341085f91e7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100452025-01-09T01:43:05.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d5c0e1e-ab9e-4d02-a515-4b13ac3a9346 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100462025-01-09T01:43:05.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d5c0e1e-ab9e-4d02-a515-4b13ac3a9346 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100472025-01-09T01:43:05.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0d5c0e1e-ab9e-4d02-a515-4b13ac3a9346 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100482025-01-09T01:43:06.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2169ad1e-c29f-4bad-aec2-a5928ce39fbe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100492025-01-09T01:43:06.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2169ad1e-c29f-4bad-aec2-a5928ce39fbe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100502025-01-09T01:43:06.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2169ad1e-c29f-4bad-aec2-a5928ce39fbe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100512025-01-09T01:43:06.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
100522025-01-09T01:43:06.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100532025-01-09T01:43:06.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100542025-01-09T01:43:06.606ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
100552025-01-09T01:43:06.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100562025-01-09T01:43:06.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100572025-01-09T01:43:06.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100582025-01-09T01:43:06.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100592025-01-09T01:43:06.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100602025-01-09T01:43:06.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100612025-01-09T01:43:06.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100622025-01-09T01:43:06.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100632025-01-09T01:43:06.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100642025-01-09T01:43:06.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100652025-01-09T01:43:06.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100662025-01-09T01:43:06.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
100672025-01-09T01:43:06.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100682025-01-09T01:43:06.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100692025-01-09T01:43:06.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
100702025-01-09T01:43:06.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.45912ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
100712025-01-09T01:43:06.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.109921ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100722025-01-09T01:43:07.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b815d950-0fef-48ef-a886-8dca8a26a1e7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100732025-01-09T01:43:07.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b815d950-0fef-48ef-a886-8dca8a26a1e7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100742025-01-09T01:43:07.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b815d950-0fef-48ef-a886-8dca8a26a1e7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100752025-01-09T01:43:08.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c73dce24-a8f3-45b3-8334-5ccb0ed7f5bb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100762025-01-09T01:43:08.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c73dce24-a8f3-45b3-8334-5ccb0ed7f5bb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100772025-01-09T01:43:08.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c73dce24-a8f3-45b3-8334-5ccb0ed7f5bb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100782025-01-09T01:43:09.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 635 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 3abd75c6-047f-4cf0-9aca-35bfab0ef1fa response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
100792025-01-09T01:43:09.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2bbde7a8-185d-47e3-b3fa-0b7cb0623041 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100802025-01-09T01:43:09.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2bbde7a8-185d-47e3-b3fa-0b7cb0623041 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100812025-01-09T01:43:09.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2bbde7a8-185d-47e3-b3fa-0b7cb0623041 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100822025-01-09T01:43:10.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40470b76-85b8-48a9-ba14-58a05331fc51 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100832025-01-09T01:43:10.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40470b76-85b8-48a9-ba14-58a05331fc51 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100842025-01-09T01:43:10.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40470b76-85b8-48a9-ba14-58a05331fc51 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100852025-01-09T01:43:11.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17b61618-c69e-46e2-a54c-3e59ded48ec6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100862025-01-09T01:43:11.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17b61618-c69e-46e2-a54c-3e59ded48ec6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100872025-01-09T01:43:11.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 17b61618-c69e-46e2-a54c-3e59ded48ec6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100882025-01-09T01:43:12.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 202df32a-4cb4-448c-9edd-32d85ac29b3f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100892025-01-09T01:43:12.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 202df32a-4cb4-448c-9edd-32d85ac29b3f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100902025-01-09T01:43:12.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 202df32a-4cb4-448c-9edd-32d85ac29b3f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100912025-01-09T01:43:13.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9799816a-1f0c-47ca-9f2e-7a78da87cc55 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100922025-01-09T01:43:13.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9799816a-1f0c-47ca-9f2e-7a78da87cc55 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100932025-01-09T01:43:13.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9799816a-1f0c-47ca-9f2e-7a78da87cc55 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100942025-01-09T01:43:14.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75a47f1b-637e-4d07-8ce5-e84fc03f2533 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100952025-01-09T01:43:14.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75a47f1b-637e-4d07-8ce5-e84fc03f2533 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100962025-01-09T01:43:14.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 75a47f1b-637e-4d07-8ce5-e84fc03f2533 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100972025-01-09T01:43:15.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b63a444b-c52e-43f5-a166-dabc7d3d91bd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100982025-01-09T01:43:15.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b63a444b-c52e-43f5-a166-dabc7d3d91bd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
100992025-01-09T01:43:15.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b63a444b-c52e-43f5-a166-dabc7d3d91bd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
101002025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
101012025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
101022025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101032025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101042025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
101052025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
101062025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101072025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101082025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101092025-01-09T01:43:16.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101102025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
101112025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
101122025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101132025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
101142025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101152025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101162025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
101172025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101182025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
101192025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101202025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
101212025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101222025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101232025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
101242025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
101252025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101262025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101272025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
101282025-01-09T01:43:16.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101292025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101302025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101312025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101322025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101332025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101342025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101352025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101362025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101372025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101382025-01-09T01:43:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101392025-01-09T01:43:16.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101402025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
101412025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101422025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
101432025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101442025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101452025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101462025-01-09T01:43:16.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1529, tv_nsec: 7780876 } })
101472025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
101482025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101492025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
101502025-01-09T01:43:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101512025-01-09T01:43:16.610ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.895513ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101522025-01-09T01:43:16.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101532025-01-09T01:43:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101542025-01-09T01:43:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101552025-01-09T01:43:16.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1529, tv_nsec: 8531148 } })
101562025-01-09T01:43:16.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101572025-01-09T01:43:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101582025-01-09T01:43:16.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101592025-01-09T01:43:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101602025-01-09T01:43:16.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612025-01-09T01:43:16.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101622025-01-09T01:43:16.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101632025-01-09T01:43:16.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101642025-01-09T01:43:16.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101652025-01-09T01:43:16.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101662025-01-09T01:43:16.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101672025-01-09T01:43:16.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101682025-01-09T01:43:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101692025-01-09T01:43:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101702025-01-09T01:43:16.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101712025-01-09T01:43:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101722025-01-09T01:43:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101732025-01-09T01:43:16.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101742025-01-09T01:43:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101752025-01-09T01:43:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101762025-01-09T01:43:16.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101772025-01-09T01:43:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101782025-01-09T01:43:16.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101792025-01-09T01:43:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101802025-01-09T01:43:16.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101812025-01-09T01:43:16.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101822025-01-09T01:43:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101832025-01-09T01:43:16.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.610495ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101842025-01-09T01:43:16.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101852025-01-09T01:43:16.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101862025-01-09T01:43:16.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101872025-01-09T01:43:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101882025-01-09T01:43:16.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1529, tv_nsec: 21599598 } })
101892025-01-09T01:43:16.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101902025-01-09T01:43:16.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
101912025-01-09T01:43:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101922025-01-09T01:43:16.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101932025-01-09T01:43:16.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101942025-01-09T01:43:16.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101952025-01-09T01:43:16.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a97c1d33-b292-4d28-9f14-f3cef277b436 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
101962025-01-09T01:43:16.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a97c1d33-b292-4d28-9f14-f3cef277b436 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
101972025-01-09T01:43:16.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.874787ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101982025-01-09T01:43:16.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a97c1d33-b292-4d28-9f14-f3cef277b436 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
101992025-01-09T01:43:16.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102002025-01-09T01:43:16.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102012025-01-09T01:43:16.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102022025-01-09T01:43:16.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102032025-01-09T01:43:16.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102042025-01-09T01:43:16.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102052025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102062025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102072025-01-09T01:43:16.647ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102082025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102092025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102102025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102112025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102122025-01-09T01:43:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102132025-01-09T01:43:16.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.259081ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
102142025-01-09T01:43:16.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102152025-01-09T01:43:16.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.870208ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
102162025-01-09T01:43:16.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102172025-01-09T01:43:16.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102182025-01-09T01:43:16.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102192025-01-09T01:43:16.659ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102202025-01-09T01:43:16.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.586466ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102212025-01-09T01:43:16.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102222025-01-09T01:43:16.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102232025-01-09T01:43:16.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102242025-01-09T01:43:16.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102252025-01-09T01:43:16.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
102262025-01-09T01:43:16.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102272025-01-09T01:43:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102282025-01-09T01:43:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
102292025-01-09T01:43:16.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102302025-01-09T01:43:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102312025-01-09T01:43:16.672ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.24973ms iteration = 20 status = 0
102322025-01-09T01:43:16.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102332025-01-09T01:43:16.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102342025-01-09T01:43:16.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102352025-01-09T01:43:16.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102362025-01-09T01:43:16.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
102372025-01-09T01:43:16.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.530542ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
102382025-01-09T01:43:16.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102392025-01-09T01:43:16.686ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102402025-01-09T01:43:16.686ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102412025-01-09T01:43:16.686ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102422025-01-09T01:43:16.686ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102432025-01-09T01:43:16.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102442025-01-09T01:43:16.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102452025-01-09T01:43:16.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102462025-01-09T01:43:16.689ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102472025-01-09T01:43:16.689ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102482025-01-09T01:43:16.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.394365ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102492025-01-09T01:43:16.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102502025-01-09T01:43:16.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102512025-01-09T01:43:16.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102522025-01-09T01:43:16.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102532025-01-09T01:43:16.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.716669ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102542025-01-09T01:43:16.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102552025-01-09T01:43:16.703ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102562025-01-09T01:43:16.703ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93a2cb2e-52dd-4c3c-bc58-b8b4192d0cb4", "content-length": "26", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102572025-01-09T01:43:16.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102582025-01-09T01:43:16.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102592025-01-09T01:43:16.705ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102602025-01-09T01:43:16.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102612025-01-09T01:43:16.705ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f18b9f-e0a3-40ad-97c9-c6865086ce24", "content-length": "26", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102622025-01-09T01:43:16.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102632025-01-09T01:43:16.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102642025-01-09T01:43:16.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.900012ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
102652025-01-09T01:43:16.736ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
102662025-01-09T01:43:16.736ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102672025-01-09T01:43:16.736ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84b3523e-49cf-4436-8e84-da55fc8889e3", "content-length": "26", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102682025-01-09T01:43:16.736ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102692025-01-09T01:43:16.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
102702025-01-09T01:43:16.835ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.858055ms iteration = 22 status = {"physical_disks_added":0}
102712025-01-09T01:43:16.850ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102722025-01-09T01:43:16.850ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c4a2622-6a6b-4c0e-a951-f6171f081d30", "content-length": "1", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102732025-01-09T01:43:16.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102742025-01-09T01:43:16.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102752025-01-09T01:43:16.860ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102762025-01-09T01:43:16.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102772025-01-09T01:43:16.861ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c7f9ecd-4329-4745-ab28-0d5d48d52e58", "content-length": "372", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102782025-01-09T01:43:16.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102792025-01-09T01:43:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102802025-01-09T01:43:16.864ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 258.163853ms iteration = 20 status = null
102812025-01-09T01:43:16.904ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102822025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102832025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102842025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.320379ms iteration = 20 status = {}
102852025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f1da038f-df6a-4f19-9d92-0323384a59b4", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102862025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102872025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef88dc15-3614-437b-9369-0cc2510aec1f", "content-length": "691", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
102882025-01-09T01:43:16.904ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102892025-01-09T01:43:16.904ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102902025-01-09T01:43:16.904ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102912025-01-09T01:43:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102922025-01-09T01:43:16.906ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 299.468277ms iteration = 20 status = {}
102932025-01-09T01:43:16.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102942025-01-09T01:43:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102952025-01-09T01:43:16.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102962025-01-09T01:43:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102972025-01-09T01:43:16.919ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102982025-01-09T01:43:16.919ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102992025-01-09T01:43:16.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae78f1a8-5de0-4e2b-ad44-02bad138e8d3", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
103002025-01-09T01:43:16.922ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 315.098589ms iteration = 20 status = {}
103012025-01-09T01:43:16.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103022025-01-09T01:43:16.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103032025-01-09T01:43:16.985ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
103042025-01-09T01:43:16.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103052025-01-09T01:43:16.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103062025-01-09T01:43:16.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103072025-01-09T01:43:16.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cfebe02-13e8-4623-88d8-1aca8d6bfa4d", "content-length": "134", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
103082025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103092025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
103102025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103112025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103122025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103132025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103142025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103152025-01-09T01:43:16.995ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103162025-01-09T01:43:16.996ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103172025-01-09T01:43:16.996ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103182025-01-09T01:43:16.996ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
103192025-01-09T01:43:16.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103202025-01-09T01:43:16.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103212025-01-09T01:43:16.998ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103222025-01-09T01:43:16.998ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c0e0b5a-27bc-4b20-b9ab-896d424ae419", "content-length": "2", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
103232025-01-09T01:43:16.998ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103242025-01-09T01:43:16.999ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "24d8a980-fb42-4a64-b02d-eae5a1b31a84", "content-length": "52", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
103252025-01-09T01:43:16.999ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
103262025-01-09T01:43:16.999ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103272025-01-09T01:43:17.100ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3a7a18a6-d4da-445b-959b-401f65fec67e", "date": "Thu, 09 Jan 2025 01:43:16 GMT"} })
103282025-01-09T01:43:17.100ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
103292025-01-09T01:43:17.100ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103302025-01-09T01:43:17.102ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a0dfb6d-30d9-4092-8372-cc33d8164097", "content-length": "682", "date": "Thu, 09 Jan 2025 01:43:17 GMT"} })
103312025-01-09T01:43:17.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103322025-01-09T01:43:17.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103332025-01-09T01:43:17.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103342025-01-09T01:43:17.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103352025-01-09T01:43:17.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103362025-01-09T01:43:17.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103372025-01-09T01:43:17.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103382025-01-09T01:43:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103392025-01-09T01:43:17.121ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 514.482396ms iteration = 20 status = {}
103402025-01-09T01:43:17.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01f3bb23-91f1-4e56-9ce9-77ecb890b007 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103412025-01-09T01:43:17.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01f3bb23-91f1-4e56-9ce9-77ecb890b007 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103422025-01-09T01:43:17.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 01f3bb23-91f1-4e56-9ce9-77ecb890b007 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103432025-01-09T01:43:18.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 61b97b26-8af5-40c2-bac8-0c36e085f15c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
103442025-01-09T01:43:18.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 61b97b26-8af5-40c2-bac8-0c36e085f15c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
103452025-01-09T01:43:18.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 61b97b26-8af5-40c2-bac8-0c36e085f15c response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
103462025-01-09T01:43:18.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b57333a-df80-4927-90f5-20732fef0aee roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103472025-01-09T01:43:18.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b57333a-df80-4927-90f5-20732fef0aee resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103482025-01-09T01:43:18.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b57333a-df80-4927-90f5-20732fef0aee response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103492025-01-09T01:43:19.297ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = d25c22a9-dae0-4d88-811f-1256d0fa4dd2 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
103502025-01-09T01:43:19.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aecd14e2-fe1c-418d-8a5f-a8eae8e4be59 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103512025-01-09T01:43:19.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aecd14e2-fe1c-418d-8a5f-a8eae8e4be59 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103522025-01-09T01:43:19.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aecd14e2-fe1c-418d-8a5f-a8eae8e4be59 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103532025-01-09T01:43:20.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 13f05e2e-f162-491d-b729-59f15ac3ca41 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103542025-01-09T01:43:20.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 13f05e2e-f162-491d-b729-59f15ac3ca41 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103552025-01-09T01:43:20.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 13f05e2e-f162-491d-b729-59f15ac3ca41 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103562025-01-09T01:43:21.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8bb050d3-cd5b-4db6-b2f4-a7df2aaec25d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103572025-01-09T01:43:21.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8bb050d3-cd5b-4db6-b2f4-a7df2aaec25d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103582025-01-09T01:43:21.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8bb050d3-cd5b-4db6-b2f4-a7df2aaec25d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103592025-01-09T01:43:22.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8a7dc526-6399-4120-ba81-9be7a818c02c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103602025-01-09T01:43:22.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8a7dc526-6399-4120-ba81-9be7a818c02c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103612025-01-09T01:43:22.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8a7dc526-6399-4120-ba81-9be7a818c02c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103622025-01-09T01:43:23.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 612e4450-c4c9-427e-8ed2-f2f79085fb55 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103632025-01-09T01:43:23.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 612e4450-c4c9-427e-8ed2-f2f79085fb55 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103642025-01-09T01:43:23.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 612e4450-c4c9-427e-8ed2-f2f79085fb55 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103652025-01-09T01:43:24.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ef65342-0795-4ee7-a3f9-ed605b1c4cd7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103662025-01-09T01:43:24.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ef65342-0795-4ee7-a3f9-ed605b1c4cd7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103672025-01-09T01:43:24.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ef65342-0795-4ee7-a3f9-ed605b1c4cd7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103682025-01-09T01:43:25.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7024a164-1e67-44a7-ac96-a0f33a57ec3d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103692025-01-09T01:43:25.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7024a164-1e67-44a7-ac96-a0f33a57ec3d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103702025-01-09T01:43:25.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7024a164-1e67-44a7-ac96-a0f33a57ec3d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103712025-01-09T01:43:26.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
103722025-01-09T01:43:26.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103732025-01-09T01:43:26.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103742025-01-09T01:43:26.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
103752025-01-09T01:43:26.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103762025-01-09T01:43:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103772025-01-09T01:43:26.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103782025-01-09T01:43:26.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103792025-01-09T01:43:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103802025-01-09T01:43:26.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.877632ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103812025-01-09T01:43:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103822025-01-09T01:43:26.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103832025-01-09T01:43:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103842025-01-09T01:43:26.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103852025-01-09T01:43:26.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103862025-01-09T01:43:26.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103872025-01-09T01:43:26.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
103882025-01-09T01:43:26.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103892025-01-09T01:43:26.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103902025-01-09T01:43:26.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
103912025-01-09T01:43:26.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.554218ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
103922025-01-09T01:43:26.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8cf6b84f-740a-4cdb-9daa-2ea3d06353fa roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103932025-01-09T01:43:26.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8cf6b84f-740a-4cdb-9daa-2ea3d06353fa resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103942025-01-09T01:43:26.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8cf6b84f-740a-4cdb-9daa-2ea3d06353fa response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103952025-01-09T01:43:27.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3520e36b-3199-4489-93ae-77b7a429ae26 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103962025-01-09T01:43:27.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3520e36b-3199-4489-93ae-77b7a429ae26 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103972025-01-09T01:43:27.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3520e36b-3199-4489-93ae-77b7a429ae26 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103982025-01-09T01:43:28.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db9db1ba-467f-4075-9ccf-c2c0a00b2feb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
103992025-01-09T01:43:28.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db9db1ba-467f-4075-9ccf-c2c0a00b2feb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104002025-01-09T01:43:28.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db9db1ba-467f-4075-9ccf-c2c0a00b2feb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104012025-01-09T01:43:29.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 2ced62a7-0054-4607-95db-879f75cae052 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
104022025-01-09T01:43:29.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5df2890-7ed4-4c84-9701-bd5ebf8d0dd6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104032025-01-09T01:43:29.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5df2890-7ed4-4c84-9701-bd5ebf8d0dd6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104042025-01-09T01:43:29.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5df2890-7ed4-4c84-9701-bd5ebf8d0dd6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104052025-01-09T01:43:30.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1cac384e-d050-425d-bef1-0fb0f16343b6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104062025-01-09T01:43:30.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1cac384e-d050-425d-bef1-0fb0f16343b6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104072025-01-09T01:43:30.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1cac384e-d050-425d-bef1-0fb0f16343b6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104082025-01-09T01:43:31.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73d1efc4-ad3d-4de7-810c-ac878e25c161 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104092025-01-09T01:43:31.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73d1efc4-ad3d-4de7-810c-ac878e25c161 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104102025-01-09T01:43:31.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 73d1efc4-ad3d-4de7-810c-ac878e25c161 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104112025-01-09T01:43:32.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83244fbc-95e4-4605-9070-ab8c8e4ac21b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104122025-01-09T01:43:32.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83244fbc-95e4-4605-9070-ab8c8e4ac21b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104132025-01-09T01:43:32.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83244fbc-95e4-4605-9070-ab8c8e4ac21b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104142025-01-09T01:43:34.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d81887f8-0074-404b-bd3e-f08700175c23 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104152025-01-09T01:43:34.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d81887f8-0074-404b-bd3e-f08700175c23 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104162025-01-09T01:43:34.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d81887f8-0074-404b-bd3e-f08700175c23 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104172025-01-09T01:43:35.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89d7d4b5-7c69-4615-b40c-e5ff62b8b8cf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104182025-01-09T01:43:35.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89d7d4b5-7c69-4615-b40c-e5ff62b8b8cf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104192025-01-09T01:43:35.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89d7d4b5-7c69-4615-b40c-e5ff62b8b8cf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104202025-01-09T01:43:36.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59d83e4d-ebad-4e02-938b-e22080c2cb40 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104212025-01-09T01:43:36.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59d83e4d-ebad-4e02-938b-e22080c2cb40 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104222025-01-09T01:43:36.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59d83e4d-ebad-4e02-938b-e22080c2cb40 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104232025-01-09T01:43:36.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
104242025-01-09T01:43:36.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104252025-01-09T01:43:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104262025-01-09T01:43:36.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
104272025-01-09T01:43:36.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104282025-01-09T01:43:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104292025-01-09T01:43:36.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104302025-01-09T01:43:36.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104312025-01-09T01:43:36.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104322025-01-09T01:43:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104332025-01-09T01:43:36.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104342025-01-09T01:43:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104352025-01-09T01:43:36.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.055495ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104362025-01-09T01:43:36.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104372025-01-09T01:43:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104382025-01-09T01:43:36.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392025-01-09T01:43:36.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
104402025-01-09T01:43:36.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104412025-01-09T01:43:36.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104422025-01-09T01:43:36.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
104432025-01-09T01:43:36.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.736718ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
104442025-01-09T01:43:37.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7df064aa-6a7f-4044-a6ae-259304bc6b8f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104452025-01-09T01:43:37.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7df064aa-6a7f-4044-a6ae-259304bc6b8f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104462025-01-09T01:43:37.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7df064aa-6a7f-4044-a6ae-259304bc6b8f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104472025-01-09T01:43:38.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33dc8761-5f47-42d4-8029-23770ccb1afe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104482025-01-09T01:43:38.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33dc8761-5f47-42d4-8029-23770ccb1afe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104492025-01-09T01:43:38.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33dc8761-5f47-42d4-8029-23770ccb1afe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104502025-01-09T01:43:39.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a2edc8bc-2722-4275-b89b-d32217285736 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104512025-01-09T01:43:39.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a2edc8bc-2722-4275-b89b-d32217285736 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104522025-01-09T01:43:39.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a2edc8bc-2722-4275-b89b-d32217285736 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104532025-01-09T01:43:39.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 894 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 09e54ed8-b567-4869-934a-aba41f26b143 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
104542025-01-09T01:43:40.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a52fa908-c5c5-4c40-bd09-a4c5173bdf78 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104552025-01-09T01:43:40.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a52fa908-c5c5-4c40-bd09-a4c5173bdf78 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104562025-01-09T01:43:40.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a52fa908-c5c5-4c40-bd09-a4c5173bdf78 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104572025-01-09T01:43:41.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76555229-ccf7-4c2a-9f01-ad87320cd415 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104582025-01-09T01:43:41.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76555229-ccf7-4c2a-9f01-ad87320cd415 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104592025-01-09T01:43:41.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76555229-ccf7-4c2a-9f01-ad87320cd415 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104602025-01-09T01:43:42.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90c6465f-0baa-4224-ab9c-7c57f31ebb43 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104612025-01-09T01:43:42.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90c6465f-0baa-4224-ab9c-7c57f31ebb43 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104622025-01-09T01:43:42.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90c6465f-0baa-4224-ab9c-7c57f31ebb43 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104632025-01-09T01:43:43.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72d7e80d-deff-40a4-ab9a-54eace261b34 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104642025-01-09T01:43:43.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72d7e80d-deff-40a4-ab9a-54eace261b34 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104652025-01-09T01:43:43.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72d7e80d-deff-40a4-ab9a-54eace261b34 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104662025-01-09T01:43:44.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2fcd2759-07df-49f9-804c-a0a1cddb881d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104672025-01-09T01:43:44.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2fcd2759-07df-49f9-804c-a0a1cddb881d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104682025-01-09T01:43:44.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2fcd2759-07df-49f9-804c-a0a1cddb881d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104692025-01-09T01:43:44.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 783cadad-294b-4eb8-8661-9fe06a378917 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
104702025-01-09T01:43:44.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 783cadad-294b-4eb8-8661-9fe06a378917 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
104712025-01-09T01:43:44.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 783cadad-294b-4eb8-8661-9fe06a378917 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
104722025-01-09T01:43:44.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 9cee259d-0ca8-48f3-9785-bf2fea59ea1c roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
104732025-01-09T01:43:44.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 9cee259d-0ca8-48f3-9785-bf2fea59ea1c resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
104742025-01-09T01:43:44.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 9cee259d-0ca8-48f3-9785-bf2fea59ea1c response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
104752025-01-09T01:43:45.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 28a61cb1-dc54-4cd6-8159-66a2d3d4b159 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104762025-01-09T01:43:45.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 28a61cb1-dc54-4cd6-8159-66a2d3d4b159 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104772025-01-09T01:43:45.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 28a61cb1-dc54-4cd6-8159-66a2d3d4b159 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104782025-01-09T01:43:46.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cfb48dcc-3463-4dfc-b560-d0bb2720362f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104792025-01-09T01:43:46.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cfb48dcc-3463-4dfc-b560-d0bb2720362f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104802025-01-09T01:43:46.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cfb48dcc-3463-4dfc-b560-d0bb2720362f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
104812025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
104822025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
104832025-01-09T01:43:46.607ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
104842025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
104852025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.13\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
104862025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
104872025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
104882025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104892025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
104902025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
104912025-01-09T01:43:46.607ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:33:46.607269881 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
104922025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
104932025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
104942025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104952025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
104962025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104972025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
104982025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
104992025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
105002025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105012025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
105022025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105032025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
105042025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
105052025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105062025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
105072025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
105082025-01-09T01:43:46.607ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
105092025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
105102025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105112025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105122025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
105132025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
105142025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105152025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105162025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105172025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
105182025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105192025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
105202025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
105212025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105222025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105232025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105242025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
105252025-01-09T01:43:46.607ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
105262025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105272025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
105282025-01-09T01:43:46.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105292025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105302025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
105312025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
105322025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
105332025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105342025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
105352025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105362025-01-09T01:43:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105372025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105382025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105392025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105402025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105412025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105422025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105432025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105442025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105452025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105462025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105472025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105482025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105492025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105502025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105512025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105522025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105532025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105542025-01-09T01:43:46.608ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 5857265 } })
105552025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105562025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105572025-01-09T01:43:46.608ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 5914006 } })
105582025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
105592025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.326021ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
105602025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
105612025-01-09T01:43:46.608ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.418803ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
105622025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105632025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
105642025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
105652025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
105662025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105672025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
105682025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105692025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
105702025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105712025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
105722025-01-09T01:43:46.609ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
105732025-01-09T01:43:46.609ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
105742025-01-09T01:43:46.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105752025-01-09T01:43:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105762025-01-09T01:43:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105772025-01-09T01:43:46.610ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
105782025-01-09T01:43:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105792025-01-09T01:43:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105802025-01-09T01:43:46.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105812025-01-09T01:43:46.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
105822025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105832025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
105842025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105852025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105862025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.930934ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105872025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105882025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105892025-01-09T01:43:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105902025-01-09T01:43:46.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 9385352 } })
105912025-01-09T01:43:46.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105922025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105932025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105942025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105952025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105962025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105972025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105982025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105992025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106002025-01-09T01:43:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106012025-01-09T01:43:46.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106022025-01-09T01:43:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106032025-01-09T01:43:46.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106042025-01-09T01:43:46.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106052025-01-09T01:43:46.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106062025-01-09T01:43:46.616ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:33:46.607269881 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
106072025-01-09T01:43:46.616ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.36972ms iteration = 11 status = {"expiration":"2025-01-09T01:33:46.607269881Z","pruned":[]}
106082025-01-09T01:43:46.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106092025-01-09T01:43:46.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106102025-01-09T01:43:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106112025-01-09T01:43:46.617ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 15105734 } })
106122025-01-09T01:43:46.617ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
106132025-01-09T01:43:46.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106142025-01-09T01:43:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106152025-01-09T01:43:46.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106162025-01-09T01:43:46.619ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106172025-01-09T01:43:46.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106182025-01-09T01:43:46.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106192025-01-09T01:43:46.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106202025-01-09T01:43:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
106212025-01-09T01:43:46.621ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106222025-01-09T01:43:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106232025-01-09T01:43:46.621ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106242025-01-09T01:43:46.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106252025-01-09T01:43:46.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106262025-01-09T01:43:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106272025-01-09T01:43:46.624ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106282025-01-09T01:43:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106292025-01-09T01:43:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106302025-01-09T01:43:46.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106312025-01-09T01:43:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106322025-01-09T01:43:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106332025-01-09T01:43:46.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106342025-01-09T01:43:46.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106352025-01-09T01:43:46.626ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.294982ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
106362025-01-09T01:43:46.629ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
106372025-01-09T01:43:46.629ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
106382025-01-09T01:43:46.629ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 19.501804ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
106392025-01-09T01:43:46.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106402025-01-09T01:43:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106412025-01-09T01:43:46.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106422025-01-09T01:43:46.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106432025-01-09T01:43:46.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106442025-01-09T01:43:46.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106452025-01-09T01:43:46.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106462025-01-09T01:43:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106472025-01-09T01:43:46.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106482025-01-09T01:43:46.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106492025-01-09T01:43:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106502025-01-09T01:43:46.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.151108ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106512025-01-09T01:43:46.638ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106522025-01-09T01:43:46.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106532025-01-09T01:43:46.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106542025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106552025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
106562025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
106572025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
106582025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106592025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106602025-01-09T01:43:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106612025-01-09T01:43:46.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106622025-01-09T01:43:46.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106632025-01-09T01:43:46.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106642025-01-09T01:43:46.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106652025-01-09T01:43:46.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106662025-01-09T01:43:46.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106672025-01-09T01:43:46.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 44362694 } })
106682025-01-09T01:43:46.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106692025-01-09T01:43:46.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
106702025-01-09T01:43:46.648ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(055d2ccc-e04f-4dc7-9a18-2ea9cfbf42b1, 0), (d4ab9d57-bb00-41fe-8442-0315c7800b81, 0), (f30db307-4006-41e7-9006-c79be6922e93, 0), (42c148f3-28c0-4f29-b196-20b557443ae6, 0)] collection_id = 055d2ccc-e04f-4dc7-9a18-2ea9cfbf42b1
106712025-01-09T01:43:46.648ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106722025-01-09T01:43:46.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106732025-01-09T01:43:46.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
106742025-01-09T01:43:46.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106752025-01-09T01:43:46.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106762025-01-09T01:43:46.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106772025-01-09T01:43:46.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106782025-01-09T01:43:46.656ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106792025-01-09T01:43:46.656ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106802025-01-09T01:43:46.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106812025-01-09T01:43:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106822025-01-09T01:43:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106832025-01-09T01:43:46.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106842025-01-09T01:43:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106852025-01-09T01:43:46.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106862025-01-09T01:43:46.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106872025-01-09T01:43:46.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106882025-01-09T01:43:46.670ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
106892025-01-09T01:43:46.670ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 61.125973ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
106902025-01-09T01:43:46.678ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106912025-01-09T01:43:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106922025-01-09T01:43:46.681ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106932025-01-09T01:43:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106942025-01-09T01:43:46.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.40312ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
106952025-01-09T01:43:46.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.816226ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
106962025-01-09T01:43:46.693ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
106972025-01-09T01:43:46.693ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.38311ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
106982025-01-09T01:43:46.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106992025-01-09T01:43:46.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107002025-01-09T01:43:46.705ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
107012025-01-09T01:43:46.705ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
107022025-01-09T01:43:46.705ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.849884ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
107032025-01-09T01:43:46.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107042025-01-09T01:43:46.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107052025-01-09T01:43:46.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107062025-01-09T01:43:46.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107072025-01-09T01:43:46.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107082025-01-09T01:43:46.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107092025-01-09T01:43:46.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107102025-01-09T01:43:46.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107112025-01-09T01:43:46.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107122025-01-09T01:43:46.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
107132025-01-09T01:43:46.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107142025-01-09T01:43:46.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107152025-01-09T01:43:46.726ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107162025-01-09T01:43:46.726ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107172025-01-09T01:43:46.726ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107182025-01-09T01:43:46.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107192025-01-09T01:43:46.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107202025-01-09T01:43:46.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107212025-01-09T01:43:46.729ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.941891ms iteration = 21 status = 0
107222025-01-09T01:43:46.732ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107232025-01-09T01:43:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107242025-01-09T01:43:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107252025-01-09T01:43:46.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107262025-01-09T01:43:46.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107272025-01-09T01:43:46.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107282025-01-09T01:43:46.735ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107292025-01-09T01:43:46.735ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 128.244533ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107302025-01-09T01:43:46.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107312025-01-09T01:43:46.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107322025-01-09T01:43:46.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107332025-01-09T01:43:46.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107342025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
107352025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
107362025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107372025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107382025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107392025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 134.22431ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107402025-01-09T01:43:46.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107412025-01-09T01:43:46.742ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107422025-01-09T01:43:46.742ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107432025-01-09T01:43:46.742ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107442025-01-09T01:43:46.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107452025-01-09T01:43:46.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107462025-01-09T01:43:46.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107472025-01-09T01:43:46.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107482025-01-09T01:43:46.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107492025-01-09T01:43:46.744ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107502025-01-09T01:43:46.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107512025-01-09T01:43:46.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107522025-01-09T01:43:46.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107532025-01-09T01:43:46.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107542025-01-09T01:43:46.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 143.903315ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107552025-01-09T01:43:46.754ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107562025-01-09T01:43:46.754ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107572025-01-09T01:43:46.754ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107582025-01-09T01:43:46.754ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.249249ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107592025-01-09T01:43:46.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107602025-01-09T01:43:46.756ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
107612025-01-09T01:43:46.756ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
107622025-01-09T01:43:46.756ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
107632025-01-09T01:43:46.756ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 055d2ccc-e04f-4dc7-9a18-2ea9cfbf42b1 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
107642025-01-09T01:43:46.756ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107652025-01-09T01:43:46.757ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 149.695858ms iteration = 11 status = {"generation":1}
107662025-01-09T01:43:46.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107672025-01-09T01:43:46.763ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(d4ab9d57-bb00-41fe-8442-0315c7800b81, 0), (f30db307-4006-41e7-9006-c79be6922e93, 0), (42c148f3-28c0-4f29-b196-20b557443ae6, 0)]
107682025-01-09T01:43:46.763ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1559, tv_nsec: 161357487 } })
107692025-01-09T01:43:46.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 160.749196ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107702025-01-09T01:43:46.775ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.394039ms iteration = 23 status = {"physical_disks_added":0}
107712025-01-09T01:43:46.786ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107722025-01-09T01:43:46.786ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
107732025-01-09T01:43:46.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107742025-01-09T01:43:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107752025-01-09T01:43:46.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107762025-01-09T01:43:46.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107772025-01-09T01:43:46.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107782025-01-09T01:43:46.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107792025-01-09T01:43:46.795ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
107802025-01-09T01:43:46.795ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107812025-01-09T01:43:46.795ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
107822025-01-09T01:43:46.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 188.585104ms iteration = 11 status = {"generation":2}
107832025-01-09T01:43:46.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107842025-01-09T01:43:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107852025-01-09T01:43:46.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107862025-01-09T01:43:46.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107872025-01-09T01:43:46.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107882025-01-09T01:43:46.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107892025-01-09T01:43:46.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107902025-01-09T01:43:46.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107912025-01-09T01:43:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107922025-01-09T01:43:46.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107932025-01-09T01:43:46.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107942025-01-09T01:43:46.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107952025-01-09T01:43:46.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107962025-01-09T01:43:46.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107972025-01-09T01:43:46.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107982025-01-09T01:43:46.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107992025-01-09T01:43:46.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108002025-01-09T01:43:46.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108012025-01-09T01:43:46.826ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108022025-01-09T01:43:46.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108032025-01-09T01:43:46.827ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108042025-01-09T01:43:46.827ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108052025-01-09T01:43:46.827ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b05563-3fc9-4b08-9e18-04565057b418", "content-length": "26", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108062025-01-09T01:43:46.827ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108072025-01-09T01:43:46.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108082025-01-09T01:43:46.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108092025-01-09T01:43:46.830ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108102025-01-09T01:43:46.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108112025-01-09T01:43:46.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108122025-01-09T01:43:46.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108132025-01-09T01:43:46.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108142025-01-09T01:43:46.841ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108152025-01-09T01:43:46.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108162025-01-09T01:43:46.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108172025-01-09T01:43:46.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108182025-01-09T01:43:46.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108192025-01-09T01:43:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108202025-01-09T01:43:46.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108212025-01-09T01:43:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108222025-01-09T01:43:46.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108232025-01-09T01:43:46.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108242025-01-09T01:43:46.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108252025-01-09T01:43:46.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108262025-01-09T01:43:46.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108272025-01-09T01:43:46.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108282025-01-09T01:43:46.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108292025-01-09T01:43:46.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108302025-01-09T01:43:46.866ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
108312025-01-09T01:43:46.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 258.56908ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
108322025-01-09T01:43:46.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108332025-01-09T01:43:46.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108342025-01-09T01:43:46.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108352025-01-09T01:43:46.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108362025-01-09T01:43:46.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108372025-01-09T01:43:46.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108382025-01-09T01:43:46.880ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
108392025-01-09T01:43:46.880ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 273.135454ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
108402025-01-09T01:43:46.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108412025-01-09T01:43:46.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108422025-01-09T01:43:46.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108432025-01-09T01:43:46.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108442025-01-09T01:43:46.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108452025-01-09T01:43:46.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108462025-01-09T01:43:46.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108472025-01-09T01:43:46.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108482025-01-09T01:43:46.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108492025-01-09T01:43:46.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108502025-01-09T01:43:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108512025-01-09T01:43:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108522025-01-09T01:43:46.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108532025-01-09T01:43:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108542025-01-09T01:43:46.912ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108552025-01-09T01:43:46.913ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108562025-01-09T01:43:46.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ae241d0-101e-43cf-9d1c-dfe49a515337", "content-length": "372", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108572025-01-09T01:43:46.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108582025-01-09T01:43:46.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108592025-01-09T01:43:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108602025-01-09T01:43:46.915ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108612025-01-09T01:43:46.915ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108622025-01-09T01:43:46.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108632025-01-09T01:43:46.918ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "789caaeb-d2e0-42c6-a28d-11d29b3048d1", "content-length": "26", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108642025-01-09T01:43:46.918ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108652025-01-09T01:43:46.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108662025-01-09T01:43:46.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108672025-01-09T01:43:46.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108682025-01-09T01:43:46.926ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
108692025-01-09T01:43:46.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108702025-01-09T01:43:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108712025-01-09T01:43:46.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108722025-01-09T01:43:46.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108732025-01-09T01:43:46.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108742025-01-09T01:43:46.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108752025-01-09T01:43:46.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
108762025-01-09T01:43:46.966ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108772025-01-09T01:43:46.966ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25ada9ca-7a22-4e09-9115-590e20b823f8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108782025-01-09T01:43:46.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108792025-01-09T01:43:46.967ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
108802025-01-09T01:43:46.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
108812025-01-09T01:43:46.994ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
108822025-01-09T01:43:46.994ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
108832025-01-09T01:43:46.994ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
108842025-01-09T01:43:46.994ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "57715cbc-b80f-41c2-9a91-b08d0b60bcb3", "content-length": "476", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108852025-01-09T01:43:46.994ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
108862025-01-09T01:43:46.995ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc24ff6f-c048-4f10-924a-24fa18fb5d5c", "content-length": "734", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108872025-01-09T01:43:46.995ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
108882025-01-09T01:43:46.995ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "39cb4300-ed54-4c97-a730-59054b30ab84", "content-length": "111", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108892025-01-09T01:43:46.995ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
108902025-01-09T01:43:46.997ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8554cefa-24bf-44c7-9fa5-49d4d3023172", "content-length": "111", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108912025-01-09T01:43:46.997ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
108922025-01-09T01:43:46.997ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27101aef-6fdf-4689-84ae-664e427ed443", "content-length": "167", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108932025-01-09T01:43:46.997ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
108942025-01-09T01:43:46.998ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "564b9548-43e8-401d-8811-f3a59b70d864", "content-length": "167", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108952025-01-09T01:43:46.998ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
108962025-01-09T01:43:46.998ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4a741ba-cf7b-49b1-b700-5a88efb086f4", "content-length": "175", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108972025-01-09T01:43:46.998ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
108982025-01-09T01:43:46.999ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e24570f-fe3c-4251-a717-1dfa441238bc", "content-length": "175", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
108992025-01-09T01:43:46.999ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
109002025-01-09T01:43:47.000ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d092e28-3867-4ba4-9978-1ca4825f05ce", "content-length": "702", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109012025-01-09T01:43:47.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
109022025-01-09T01:43:47.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a826caf-bf2e-44f5-a77e-2f2c34c0576c", "content-length": "727", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109032025-01-09T01:43:47.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
109042025-01-09T01:43:47.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4754301-9bce-47d4-a1cd-fc18947b2452", "content-length": "729", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109052025-01-09T01:43:47.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
109062025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "011ed8dd-e0ae-4c0a-82cf-48d41d097925", "content-length": "728", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109072025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
109082025-01-09T01:43:47.003ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109092025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109102025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b04ba345-e154-4afd-ac44-ce9f9b26777b", "content-length": "722", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109112025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
109122025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "69094ba3-f589-4a22-8d23-84b09985ea33", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109132025-01-09T01:43:47.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109142025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c595655-b93e-41b4-9145-41662391c948", "content-length": "109", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109152025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
109162025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109172025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "43abad79-3e83-486c-846f-b484b6eec2db", "content-length": "109", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109182025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
109192025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2740aa7-0634-4a4a-a6fc-01cc98da12bb", "content-length": "169", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109202025-01-09T01:43:47.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
109212025-01-09T01:43:47.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f6b5d24-e456-4f3c-b21b-ba107fc6a07d", "content-length": "169", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109222025-01-09T01:43:47.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
109232025-01-09T01:43:47.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0068a3-24c3-4e75-82b1-7536d1f48442", "content-length": "178", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109242025-01-09T01:43:47.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
109252025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "916c892b-7c2e-4522-8e95-8675ec90ed63", "content-length": "178", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109262025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
109272025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109282025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fea1d91c-932b-40ab-95b1-9b784ef78d07", "content-length": "702", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109292025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
109302025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dd67131-0d8f-4920-8ee4-0d637d01538b", "content-length": "727", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109312025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
109322025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109332025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "74979359-b8fa-48f5-a7c2-e88e254d7449", "content-length": "729", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109342025-01-09T01:43:47.006ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
109352025-01-09T01:43:47.007ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0f9c92-d7fb-4a86-89a1-aa38b22c36c4", "content-length": "728", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109362025-01-09T01:43:47.007ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109372025-01-09T01:43:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109382025-01-09T01:43:47.106ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109392025-01-09T01:43:47.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "68f76cb9-caae-4f7e-bed5-a6c4b8039361", "content-length": "691", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109402025-01-09T01:43:47.106ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
109412025-01-09T01:43:47.106ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
109422025-01-09T01:43:47.106ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
109432025-01-09T01:43:47.108ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 501.331275ms iteration = 21 status = {}
109442025-01-09T01:43:47.109ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109452025-01-09T01:43:47.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109462025-01-09T01:43:47.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109472025-01-09T01:43:47.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109482025-01-09T01:43:47.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
109492025-01-09T01:43:47.112ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109502025-01-09T01:43:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109512025-01-09T01:43:47.113ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109522025-01-09T01:43:47.113ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109532025-01-09T01:43:47.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109542025-01-09T01:43:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109552025-01-09T01:43:47.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109562025-01-09T01:43:47.114ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109572025-01-09T01:43:47.115ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109582025-01-09T01:43:47.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109592025-01-09T01:43:47.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
109602025-01-09T01:43:47.116ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109612025-01-09T01:43:47.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109622025-01-09T01:43:47.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109632025-01-09T01:43:47.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109642025-01-09T01:43:47.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109652025-01-09T01:43:47.118ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109662025-01-09T01:43:47.118ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109672025-01-09T01:43:47.119ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ce10288c-8470-4ea0-a88a-ad58e2726410", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109682025-01-09T01:43:47.120ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 513.296627ms iteration = 21 status = {}
109692025-01-09T01:43:47.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109702025-01-09T01:43:47.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109712025-01-09T01:43:47.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109722025-01-09T01:43:47.135ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
109732025-01-09T01:43:47.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109742025-01-09T01:43:47.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109752025-01-09T01:43:47.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109762025-01-09T01:43:47.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109772025-01-09T01:43:47.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109782025-01-09T01:43:47.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109792025-01-09T01:43:47.141ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109802025-01-09T01:43:47.141ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109812025-01-09T01:43:47.141ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109822025-01-09T01:43:47.205ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, time_created: 2025-01-09T01:34:22.988660Z, time_modified: 2025-01-09T01:34:22.988660Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
109832025-01-09T01:43:47.205ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
109842025-01-09T01:43:47.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109852025-01-09T01:43:47.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109862025-01-09T01:43:47.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109872025-01-09T01:43:47.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109882025-01-09T01:43:47.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109892025-01-09T01:43:47.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
109902025-01-09T01:43:47.218ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109912025-01-09T01:43:47.219ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6bc51d7-2119-4b35-973d-50e8136e3261", "content-length": "1", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
109922025-01-09T01:43:47.220ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109932025-01-09T01:43:47.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109942025-01-09T01:43:47.223ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 616.171061ms iteration = 21 status = null
109952025-01-09T01:43:47.242ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 634.906593ms iteration = 21 status = {}
109962025-01-09T01:43:47.250ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
109972025-01-09T01:43:47.250ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "287625f4-4e0e-47de-9963-7fc66c3d0f02", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
109982025-01-09T01:43:47.250ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
109992025-01-09T01:43:47.252ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9fd5b802-eb8d-44ad-bcf2-c5b2d6da1fbb", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110002025-01-09T01:43:47.252ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110012025-01-09T01:43:47.254ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110022025-01-09T01:43:47.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 647.512926ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
110032025-01-09T01:43:47.262ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
110042025-01-09T01:43:47.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9b9feecc-5505-4891-bd42-9ddab2192b0d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
110052025-01-09T01:43:47.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9b9feecc-5505-4891-bd42-9ddab2192b0d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
110062025-01-09T01:43:47.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = daadb0f8-f63d-41ba-8a5f-9f18a2cce32c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110072025-01-09T01:43:47.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = daadb0f8-f63d-41ba-8a5f-9f18a2cce32c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110082025-01-09T01:43:47.328ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
110092025-01-09T01:43:47.328ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
110102025-01-09T01:43:47.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = daadb0f8-f63d-41ba-8a5f-9f18a2cce32c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110112025-01-09T01:43:47.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9b9feecc-5505-4891-bd42-9ddab2192b0d response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
110122025-01-09T01:43:47.336ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
110132025-01-09T01:43:47.361ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "79348ccf-6b8f-467f-8462-2e86575afa36", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} })
110142025-01-09T01:43:47.362ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
110152025-01-09T01:43:47.362ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 755.290799ms
110162025-01-09T01:43:47.362ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 755.299329ms iteration = 3 status = {}
110172025-01-09T01:43:47.372ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
110182025-01-09T01:43:47.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0721845e-55a4-494c-bd69-aea86acf3c65", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110192025-01-09T01:43:47.373ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110202025-01-09T01:43:47.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "eb8b4f0d-89c1-4e87-b167-ae0028d06bc5", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110212025-01-09T01:43:47.375ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110222025-01-09T01:43:47.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "29b78d0a-2974-4442-9597-22197b5a564a", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110232025-01-09T01:43:47.377ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110242025-01-09T01:43:47.379ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110252025-01-09T01:43:47.379ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 772.186151ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
110262025-01-09T01:43:47.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110272025-01-09T01:43:47.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110282025-01-09T01:43:47.385ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
110292025-01-09T01:43:47.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110302025-01-09T01:43:47.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110312025-01-09T01:43:47.396ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
110322025-01-09T01:43:47.396ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40ef3d3c-1a09-40bc-85cb-c7c9168111a0", "content-length": "134", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
110332025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
110342025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
110352025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110362025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110372025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110382025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110392025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110402025-01-09T01:43:47.396ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110412025-01-09T01:43:47.397ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110422025-01-09T01:43:47.397ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110432025-01-09T01:43:47.397ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
110442025-01-09T01:43:47.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110452025-01-09T01:43:47.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110462025-01-09T01:43:47.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110472025-01-09T01:43:47.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e150226c-3ce7-4b59-a17a-9e02f4fcfe39", "content-length": "2", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
110482025-01-09T01:43:47.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110492025-01-09T01:43:47.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9779f9f4-0ae1-4188-a59e-bb9e59f64170", "content-length": "52", "date": "Thu, 09 Jan 2025 01:43:46 GMT"} })
110502025-01-09T01:43:47.399ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
110512025-01-09T01:43:47.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110522025-01-09T01:43:47.561ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "35bc1db6-dc10-4eab-8048-2ecd5d38866a", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} })
110532025-01-09T01:43:47.561ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
110542025-01-09T01:43:47.561ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110552025-01-09T01:43:47.566ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "09559a74-4a0e-42da-bcdb-0ed7b1a5f46f", "content-length": "682", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} })
110562025-01-09T01:43:47.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110572025-01-09T01:43:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110582025-01-09T01:43:47.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110592025-01-09T01:43:47.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110602025-01-09T01:43:47.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110612025-01-09T01:43:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110622025-01-09T01:43:47.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110632025-01-09T01:43:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110642025-01-09T01:43:47.583ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 975.926209ms iteration = 21 status = {}
110652025-01-09T01:43:47.743ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd92dec0-c03c-4e5e-a881-c756a8b5208b", "content-length": "30801", "date": "Thu, 09 Jan 2025 01:43:47 GMT"} })
110662025-01-09T01:43:47.746ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
110672025-01-09T01:43:47.746ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
110682025-01-09T01:43:47.746ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
110692025-01-09T01:43:47.747ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110702025-01-09T01:43:47.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110712025-01-09T01:43:47.749ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110722025-01-09T01:43:47.751ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110732025-01-09T01:43:47.751ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110742025-01-09T01:43:47.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110752025-01-09T01:43:47.915ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 28eea42d-5a58-4402-9e84-b0f9d3244275 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
110762025-01-09T01:43:47.915ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 28eea42d-5a58-4402-9e84-b0f9d3244275 time_started = 2025-01-09 01:43:46.994057 UTC
110772025-01-09T01:43:47.915ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.307842618s iteration = 3 status = {"collection_id":"28eea42d-5a58-4402-9e84-b0f9d3244275","time_done":"2025-01-09 01:43:47.746006 UTC","time_started":"2025-01-09 01:43:46.994057 UTC"}
110782025-01-09T01:43:47.915ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
110792025-01-09T01:43:47.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110802025-01-09T01:43:47.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110812025-01-09T01:43:47.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110822025-01-09T01:43:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110832025-01-09T01:43:47.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110842025-01-09T01:43:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110852025-01-09T01:43:47.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110862025-01-09T01:43:47.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110872025-01-09T01:43:47.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110882025-01-09T01:43:47.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110892025-01-09T01:43:47.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110902025-01-09T01:43:47.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110912025-01-09T01:43:47.937ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.185337ms iteration = 24 status = {"physical_disks_added":0}
110922025-01-09T01:43:48.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c36c49a4-4942-4bc2-b2ba-afb96bae6e6d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110932025-01-09T01:43:48.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c36c49a4-4942-4bc2-b2ba-afb96bae6e6d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110942025-01-09T01:43:48.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c36c49a4-4942-4bc2-b2ba-afb96bae6e6d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110952025-01-09T01:43:49.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 05836c83-d7cb-4d8d-8578-1a191ed7085d response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
110962025-01-09T01:43:49.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ba5b046-d919-422d-a329-dd15fb58d141 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110972025-01-09T01:43:49.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ba5b046-d919-422d-a329-dd15fb58d141 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110982025-01-09T01:43:49.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ba5b046-d919-422d-a329-dd15fb58d141 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
110992025-01-09T01:43:50.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4ae0f31b-4dc6-44ec-8f1a-6af40a315add roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111002025-01-09T01:43:50.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4ae0f31b-4dc6-44ec-8f1a-6af40a315add resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111012025-01-09T01:43:50.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4ae0f31b-4dc6-44ec-8f1a-6af40a315add response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111022025-01-09T01:43:51.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5bc49e5-02a9-4687-a95f-7bf069c3406b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111032025-01-09T01:43:51.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5bc49e5-02a9-4687-a95f-7bf069c3406b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111042025-01-09T01:43:51.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5bc49e5-02a9-4687-a95f-7bf069c3406b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111052025-01-09T01:43:52.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b263915c-3965-491d-a4f6-db104fbf6bb1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111062025-01-09T01:43:52.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b263915c-3965-491d-a4f6-db104fbf6bb1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111072025-01-09T01:43:52.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b263915c-3965-491d-a4f6-db104fbf6bb1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111082025-01-09T01:43:53.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5806f77e-cfa7-49c7-9e5d-cc5f3c6e2688 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111092025-01-09T01:43:53.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5806f77e-cfa7-49c7-9e5d-cc5f3c6e2688 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111102025-01-09T01:43:53.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5806f77e-cfa7-49c7-9e5d-cc5f3c6e2688 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111112025-01-09T01:43:54.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2180929-d056-4d24-bf88-d60600ec1709 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111122025-01-09T01:43:54.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2180929-d056-4d24-bf88-d60600ec1709 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111132025-01-09T01:43:54.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e2180929-d056-4d24-bf88-d60600ec1709 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111142025-01-09T01:43:55.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 435a40a4-3472-45c2-b537-3cdbb8bf9672 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111152025-01-09T01:43:55.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 435a40a4-3472-45c2-b537-3cdbb8bf9672 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111162025-01-09T01:43:55.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 435a40a4-3472-45c2-b537-3cdbb8bf9672 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111172025-01-09T01:43:56.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0b27777-99a1-46d7-b494-1d75ac279711 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111182025-01-09T01:43:56.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0b27777-99a1-46d7-b494-1d75ac279711 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111192025-01-09T01:43:56.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0b27777-99a1-46d7-b494-1d75ac279711 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111202025-01-09T01:43:56.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
111212025-01-09T01:43:56.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111222025-01-09T01:43:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111232025-01-09T01:43:56.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
111242025-01-09T01:43:56.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111252025-01-09T01:43:56.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111262025-01-09T01:43:56.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111272025-01-09T01:43:56.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111282025-01-09T01:43:56.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111292025-01-09T01:43:56.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111302025-01-09T01:43:56.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111312025-01-09T01:43:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111322025-01-09T01:43:56.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.939684ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111332025-01-09T01:43:56.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111342025-01-09T01:43:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111352025-01-09T01:43:56.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111362025-01-09T01:43:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
111372025-01-09T01:43:56.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111382025-01-09T01:43:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111392025-01-09T01:43:56.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
111402025-01-09T01:43:56.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.121102ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
111412025-01-09T01:43:57.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 50c09a92-8669-472e-974b-c223dee183c8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111422025-01-09T01:43:57.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 50c09a92-8669-472e-974b-c223dee183c8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111432025-01-09T01:43:57.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 50c09a92-8669-472e-974b-c223dee183c8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111442025-01-09T01:43:58.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3a3bf95-05ce-4b2c-b103-01f74d5d57c4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111452025-01-09T01:43:58.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3a3bf95-05ce-4b2c-b103-01f74d5d57c4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111462025-01-09T01:43:58.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a3a3bf95-05ce-4b2c-b103-01f74d5d57c4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111472025-01-09T01:43:59.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 548da62a-8d27-4c19-a302-8430fb278240 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
111482025-01-09T01:43:59.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 548da62a-8d27-4c19-a302-8430fb278240 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
111492025-01-09T01:43:59.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 656 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = c28051da-7df0-4387-9e24-84509ab35519 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
111502025-01-09T01:43:59.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 548da62a-8d27-4c19-a302-8430fb278240 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
111512025-01-09T01:43:59.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4b64f0db-208c-4734-a810-16b4082cca5f roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
111522025-01-09T01:43:59.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4b64f0db-208c-4734-a810-16b4082cca5f resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
111532025-01-09T01:43:59.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4b64f0db-208c-4734-a810-16b4082cca5f response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
111542025-01-09T01:43:59.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf8df327-2880-431d-95a1-119a59cba7d4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111552025-01-09T01:43:59.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf8df327-2880-431d-95a1-119a59cba7d4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111562025-01-09T01:43:59.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bf8df327-2880-431d-95a1-119a59cba7d4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111572025-01-09T01:44:00.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f33b52d4-a1d3-4427-a8a8-4a24160c2a94 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111582025-01-09T01:44:00.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f33b52d4-a1d3-4427-a8a8-4a24160c2a94 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111592025-01-09T01:44:00.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f33b52d4-a1d3-4427-a8a8-4a24160c2a94 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111602025-01-09T01:44:01.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b1073a5-cf4c-4ab5-a145-e53eb0d76e3c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111612025-01-09T01:44:01.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b1073a5-cf4c-4ab5-a145-e53eb0d76e3c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111622025-01-09T01:44:01.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b1073a5-cf4c-4ab5-a145-e53eb0d76e3c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111632025-01-09T01:44:02.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c092b30c-1d52-4a96-9d09-089db848611f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111642025-01-09T01:44:02.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c092b30c-1d52-4a96-9d09-089db848611f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111652025-01-09T01:44:02.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c092b30c-1d52-4a96-9d09-089db848611f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111662025-01-09T01:44:03.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = edab272c-757f-4627-b383-9e3c25270609 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111672025-01-09T01:44:03.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = edab272c-757f-4627-b383-9e3c25270609 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111682025-01-09T01:44:03.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = edab272c-757f-4627-b383-9e3c25270609 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111692025-01-09T01:44:04.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7515e25d-b3a1-4f26-ae2c-4c1d1b696914 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111702025-01-09T01:44:04.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7515e25d-b3a1-4f26-ae2c-4c1d1b696914 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111712025-01-09T01:44:04.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7515e25d-b3a1-4f26-ae2c-4c1d1b696914 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111722025-01-09T01:44:05.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 957cbf28-bfda-4d94-9e43-7bddba590c7f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111732025-01-09T01:44:05.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 957cbf28-bfda-4d94-9e43-7bddba590c7f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111742025-01-09T01:44:05.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 957cbf28-bfda-4d94-9e43-7bddba590c7f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111752025-01-09T01:44:06.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
111762025-01-09T01:44:06.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111772025-01-09T01:44:06.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111782025-01-09T01:44:06.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
111792025-01-09T01:44:06.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111802025-01-09T01:44:06.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111812025-01-09T01:44:06.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111822025-01-09T01:44:06.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111832025-01-09T01:44:06.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111842025-01-09T01:44:06.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111852025-01-09T01:44:06.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111862025-01-09T01:44:06.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111872025-01-09T01:44:06.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111882025-01-09T01:44:06.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111892025-01-09T01:44:06.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111902025-01-09T01:44:06.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
111912025-01-09T01:44:06.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111922025-01-09T01:44:06.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111932025-01-09T01:44:06.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
111942025-01-09T01:44:06.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.653958ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
111952025-01-09T01:44:06.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.664969ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111962025-01-09T01:44:06.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 51b16dcc-3141-40e2-ad33-736adbb32ef3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111972025-01-09T01:44:06.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 51b16dcc-3141-40e2-ad33-736adbb32ef3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111982025-01-09T01:44:06.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 51b16dcc-3141-40e2-ad33-736adbb32ef3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
111992025-01-09T01:44:07.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d06c3dae-ff17-4d9d-ae1d-4c03f0b34737 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112002025-01-09T01:44:07.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d06c3dae-ff17-4d9d-ae1d-4c03f0b34737 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112012025-01-09T01:44:07.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d06c3dae-ff17-4d9d-ae1d-4c03f0b34737 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112022025-01-09T01:44:08.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1f6caae8-dd54-4dc6-8576-e2822c3300ba roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112032025-01-09T01:44:08.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1f6caae8-dd54-4dc6-8576-e2822c3300ba resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112042025-01-09T01:44:08.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1f6caae8-dd54-4dc6-8576-e2822c3300ba response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112052025-01-09T01:44:09.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 532 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 14f4e8d4-66cd-40a0-a4a8-760831815ded response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
112062025-01-09T01:44:09.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 91a50362-9a3f-426d-b54c-ccf65690d178 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112072025-01-09T01:44:09.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 91a50362-9a3f-426d-b54c-ccf65690d178 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112082025-01-09T01:44:09.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 91a50362-9a3f-426d-b54c-ccf65690d178 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112092025-01-09T01:44:10.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38b2e48c-e468-4abd-ac40-22dd57cdb130 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112102025-01-09T01:44:10.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38b2e48c-e468-4abd-ac40-22dd57cdb130 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112112025-01-09T01:44:10.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38b2e48c-e468-4abd-ac40-22dd57cdb130 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112122025-01-09T01:44:11.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d86dd0a7-f2f0-4521-a613-857a179b6beb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112132025-01-09T01:44:11.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d86dd0a7-f2f0-4521-a613-857a179b6beb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112142025-01-09T01:44:11.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d86dd0a7-f2f0-4521-a613-857a179b6beb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112152025-01-09T01:44:12.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 32932373-7638-4a18-8ac9-c1f17cf28a19 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112162025-01-09T01:44:12.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 32932373-7638-4a18-8ac9-c1f17cf28a19 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112172025-01-09T01:44:12.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 32932373-7638-4a18-8ac9-c1f17cf28a19 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112182025-01-09T01:44:13.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5234d9b9-c745-4fdc-8814-3955a46ab0e3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112192025-01-09T01:44:13.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5234d9b9-c745-4fdc-8814-3955a46ab0e3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112202025-01-09T01:44:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5234d9b9-c745-4fdc-8814-3955a46ab0e3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112212025-01-09T01:44:14.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b6bb7849-5b3d-4ea5-9ca5-d56a464cf156 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112222025-01-09T01:44:14.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b6bb7849-5b3d-4ea5-9ca5-d56a464cf156 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112232025-01-09T01:44:14.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b6bb7849-5b3d-4ea5-9ca5-d56a464cf156 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112242025-01-09T01:44:15.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 225a61d0-77be-48ef-9dd1-eb2220141fcf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112252025-01-09T01:44:15.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 225a61d0-77be-48ef-9dd1-eb2220141fcf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112262025-01-09T01:44:15.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 225a61d0-77be-48ef-9dd1-eb2220141fcf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112272025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
112282025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112292025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
112302025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
112312025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112322025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
112332025-01-09T01:44:16.606ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112342025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112352025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112362025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112372025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
112382025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
112392025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112402025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
112412025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112422025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112432025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
112442025-01-09T01:44:16.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112452025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
112462025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112472025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112482025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
112492025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
112502025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112512025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
112522025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112532025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
112542025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112552025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
112562025-01-09T01:44:16.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112572025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112582025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112592025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112602025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112612025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112622025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112632025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112642025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112652025-01-09T01:44:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112662025-01-09T01:44:16.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112672025-01-09T01:44:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
112682025-01-09T01:44:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
112692025-01-09T01:44:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
112702025-01-09T01:44:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112712025-01-09T01:44:16.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 7041834 } })
112722025-01-09T01:44:16.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 7168076 } })
112732025-01-09T01:44:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112742025-01-09T01:44:16.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
112752025-01-09T01:44:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
112762025-01-09T01:44:16.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
112772025-01-09T01:44:16.610ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.634598ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
112782025-01-09T01:44:16.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112792025-01-09T01:44:16.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
112802025-01-09T01:44:16.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
112812025-01-09T01:44:16.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
112822025-01-09T01:44:16.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112832025-01-09T01:44:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
112842025-01-09T01:44:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112852025-01-09T01:44:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112862025-01-09T01:44:16.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112872025-01-09T01:44:16.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112882025-01-09T01:44:16.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112892025-01-09T01:44:16.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
112902025-01-09T01:44:16.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112912025-01-09T01:44:16.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112922025-01-09T01:44:16.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112932025-01-09T01:44:16.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112942025-01-09T01:44:16.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112952025-01-09T01:44:16.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112962025-01-09T01:44:16.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112972025-01-09T01:44:16.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112982025-01-09T01:44:16.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112992025-01-09T01:44:16.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113002025-01-09T01:44:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113012025-01-09T01:44:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113022025-01-09T01:44:16.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113032025-01-09T01:44:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113042025-01-09T01:44:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113052025-01-09T01:44:16.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113062025-01-09T01:44:16.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113072025-01-09T01:44:16.620ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113082025-01-09T01:44:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113092025-01-09T01:44:16.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113102025-01-09T01:44:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113112025-01-09T01:44:16.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113122025-01-09T01:44:16.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1589, tv_nsec: 20914687 } })
113132025-01-09T01:44:16.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
113142025-01-09T01:44:16.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113152025-01-09T01:44:16.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.020311ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113162025-01-09T01:44:16.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113172025-01-09T01:44:16.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113182025-01-09T01:44:16.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113192025-01-09T01:44:16.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113202025-01-09T01:44:16.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113212025-01-09T01:44:16.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113222025-01-09T01:44:16.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113232025-01-09T01:44:16.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113242025-01-09T01:44:16.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.191103ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113252025-01-09T01:44:16.649ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113262025-01-09T01:44:16.649ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
113272025-01-09T01:44:16.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113282025-01-09T01:44:16.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113292025-01-09T01:44:16.652ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113302025-01-09T01:44:16.652ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113312025-01-09T01:44:16.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113322025-01-09T01:44:16.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113332025-01-09T01:44:16.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113342025-01-09T01:44:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113352025-01-09T01:44:16.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113362025-01-09T01:44:16.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113372025-01-09T01:44:16.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.033105ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
113382025-01-09T01:44:16.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113392025-01-09T01:44:16.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.121716ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
113402025-01-09T01:44:16.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113412025-01-09T01:44:16.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113422025-01-09T01:44:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
113432025-01-09T01:44:16.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113442025-01-09T01:44:16.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113452025-01-09T01:44:16.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113462025-01-09T01:44:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113472025-01-09T01:44:16.680ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113482025-01-09T01:44:16.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.440925ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113492025-01-09T01:44:16.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113502025-01-09T01:44:16.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113512025-01-09T01:44:16.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113522025-01-09T01:44:16.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113532025-01-09T01:44:16.732ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
113542025-01-09T01:44:16.732ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113552025-01-09T01:44:16.732ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35216ccc-62c8-4f7d-875d-d573db25233c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
113562025-01-09T01:44:16.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113572025-01-09T01:44:16.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113582025-01-09T01:44:16.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
113592025-01-09T01:44:16.735ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113602025-01-09T01:44:16.736ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9eb745c-fff7-4320-b799-90916d25e74e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
113612025-01-09T01:44:16.736ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113622025-01-09T01:44:16.737ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113632025-01-09T01:44:16.857ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 250.590661ms iteration = 22 status = {}
113642025-01-09T01:44:16.862ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113652025-01-09T01:44:16.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113662025-01-09T01:44:16.863ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113672025-01-09T01:44:16.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "04c92324-2d12-450a-8be4-24efa3923c62", "content-length": "372", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
113682025-01-09T01:44:16.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113692025-01-09T01:44:16.863ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4287c306-1987-47a4-aaae-609025f7c5b5", "content-length": "1", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
113702025-01-09T01:44:16.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113712025-01-09T01:44:16.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
113722025-01-09T01:44:16.865ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113732025-01-09T01:44:16.865ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113742025-01-09T01:44:16.865ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd7cd32b-136f-4f12-9bc4-420f0a3f6076", "content-length": "26", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
113752025-01-09T01:44:16.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113762025-01-09T01:44:16.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113772025-01-09T01:44:16.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
113782025-01-09T01:44:16.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113792025-01-09T01:44:16.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113802025-01-09T01:44:16.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113812025-01-09T01:44:16.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113822025-01-09T01:44:16.870ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.17971ms iteration = 22 status = null
113832025-01-09T01:44:16.880ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
113842025-01-09T01:44:16.880ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 273.568791ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
113852025-01-09T01:44:16.901ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113862025-01-09T01:44:16.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113872025-01-09T01:44:16.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 293.47477ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113882025-01-09T01:44:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 300.364151ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
113892025-01-09T01:44:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113902025-01-09T01:44:16.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 306.288217ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113912025-01-09T01:44:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
113922025-01-09T01:44:16.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113932025-01-09T01:44:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113942025-01-09T01:44:16.920ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 312.814852ms iteration = 22 status = 0
113952025-01-09T01:44:16.937ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
113962025-01-09T01:44:16.937ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113972025-01-09T01:44:16.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113982025-01-09T01:44:16.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113992025-01-09T01:44:16.989ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
114002025-01-09T01:44:16.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114012025-01-09T01:44:16.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114022025-01-09T01:44:16.990ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 382.773247ms iteration = 25 status = {"physical_disks_added":0}
114032025-01-09T01:44:16.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114042025-01-09T01:44:16.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114052025-01-09T01:44:17.000ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
114062025-01-09T01:44:17.000ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c2d0370-b8ee-4a17-8ac7-9268c2fc7a9c", "content-length": "134", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
114072025-01-09T01:44:17.000ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
114082025-01-09T01:44:17.000ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
114092025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
114102025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
114112025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114122025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114132025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114142025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114152025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114162025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114172025-01-09T01:44:17.001ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
114182025-01-09T01:44:17.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114192025-01-09T01:44:17.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114202025-01-09T01:44:17.003ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
114212025-01-09T01:44:17.003ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1be0441-7494-4180-ab24-3e0d3343cb89", "content-length": "2", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
114222025-01-09T01:44:17.003ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
114232025-01-09T01:44:17.003ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e959145-87ee-4bbf-806a-b1dfd277e49d", "content-length": "52", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
114242025-01-09T01:44:17.003ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
114252025-01-09T01:44:17.003ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
114262025-01-09T01:44:17.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114272025-01-09T01:44:17.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114282025-01-09T01:44:17.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114292025-01-09T01:44:17.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114302025-01-09T01:44:17.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114312025-01-09T01:44:17.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114322025-01-09T01:44:17.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114332025-01-09T01:44:17.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114342025-01-09T01:44:17.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6962c3d5-4e5d-4429-8762-85c4fe1d43fc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114352025-01-09T01:44:17.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6962c3d5-4e5d-4429-8762-85c4fe1d43fc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114362025-01-09T01:44:17.042ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47f89898-a1fc-4689-a738-fe26ae866b23", "date": "Thu, 09 Jan 2025 01:44:17 GMT"} })
114372025-01-09T01:44:17.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114382025-01-09T01:44:17.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114392025-01-09T01:44:17.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6962c3d5-4e5d-4429-8762-85c4fe1d43fc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114402025-01-09T01:44:17.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114412025-01-09T01:44:17.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114422025-01-09T01:44:17.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114432025-01-09T01:44:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114442025-01-09T01:44:17.056ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114452025-01-09T01:44:17.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114462025-01-09T01:44:17.057ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5d4b4907-f075-4636-9421-c0a66e791c06", "date": "Thu, 09 Jan 2025 01:44:17 GMT"} })
114472025-01-09T01:44:17.058ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 450.585668ms iteration = 22 status = {}
114482025-01-09T01:44:17.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114492025-01-09T01:44:17.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "25bbfa2b-0f98-4ffe-9505-2857822b8673", "content-length": "691", "date": "Thu, 09 Jan 2025 01:44:17 GMT"} })
114502025-01-09T01:44:17.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
114512025-01-09T01:44:17.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
114522025-01-09T01:44:17.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
114532025-01-09T01:44:17.137ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.197269ms iteration = 22 status = {}
114542025-01-09T01:44:17.156ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a3e2e6e1-6ad7-49fd-aee0-84264ad7d044", "date": "Thu, 09 Jan 2025 01:44:16 GMT"} })
114552025-01-09T01:44:17.156ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
114562025-01-09T01:44:17.156ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
114572025-01-09T01:44:17.156ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "67f6f699-be5b-47be-892f-56f3f5bf13ab", "content-length": "682", "date": "Thu, 09 Jan 2025 01:44:17 GMT"} })
114582025-01-09T01:44:17.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114592025-01-09T01:44:17.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114602025-01-09T01:44:17.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114612025-01-09T01:44:17.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114622025-01-09T01:44:17.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114632025-01-09T01:44:17.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114642025-01-09T01:44:17.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114652025-01-09T01:44:17.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114662025-01-09T01:44:17.173ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 565.592578ms iteration = 22 status = {}
114672025-01-09T01:44:17.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f544d989-3989-4cfe-8227-ec05ccba58f3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
114682025-01-09T01:44:17.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f544d989-3989-4cfe-8227-ec05ccba58f3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
114692025-01-09T01:44:17.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f544d989-3989-4cfe-8227-ec05ccba58f3 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
114702025-01-09T01:44:18.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d441f7d-9356-4a58-8a32-a1fd67ee4268 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114712025-01-09T01:44:18.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d441f7d-9356-4a58-8a32-a1fd67ee4268 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114722025-01-09T01:44:18.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d441f7d-9356-4a58-8a32-a1fd67ee4268 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114732025-01-09T01:44:19.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 281df35a-91ca-47f2-a8f4-8e0257def36a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114742025-01-09T01:44:19.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 281df35a-91ca-47f2-a8f4-8e0257def36a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114752025-01-09T01:44:19.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 281df35a-91ca-47f2-a8f4-8e0257def36a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114762025-01-09T01:44:19.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 6e338472-e6a1-4424-8a90-d203a012ea27 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
114772025-01-09T01:44:20.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 577dc761-2fb5-4f23-9dff-7efd319bf693 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114782025-01-09T01:44:20.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 577dc761-2fb5-4f23-9dff-7efd319bf693 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114792025-01-09T01:44:20.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 577dc761-2fb5-4f23-9dff-7efd319bf693 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114802025-01-09T01:44:21.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5d066790-fbd4-4e69-92f5-476b3bee7802 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114812025-01-09T01:44:21.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5d066790-fbd4-4e69-92f5-476b3bee7802 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114822025-01-09T01:44:21.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5d066790-fbd4-4e69-92f5-476b3bee7802 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114832025-01-09T01:44:22.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d6bd64b-51a0-4652-b380-afff583e8327 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114842025-01-09T01:44:22.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d6bd64b-51a0-4652-b380-afff583e8327 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114852025-01-09T01:44:22.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9d6bd64b-51a0-4652-b380-afff583e8327 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114862025-01-09T01:44:23.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f9636b-963d-4b3d-942c-66e25d5dd4be roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114872025-01-09T01:44:23.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f9636b-963d-4b3d-942c-66e25d5dd4be resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114882025-01-09T01:44:23.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 45f9636b-963d-4b3d-942c-66e25d5dd4be response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114892025-01-09T01:44:24.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1cb4dc3-7957-495e-913d-d15e5305576a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114902025-01-09T01:44:24.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1cb4dc3-7957-495e-913d-d15e5305576a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114912025-01-09T01:44:24.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1cb4dc3-7957-495e-913d-d15e5305576a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114922025-01-09T01:44:25.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a70122e4-2942-4107-ac7b-1d239c7bf30d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114932025-01-09T01:44:25.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a70122e4-2942-4107-ac7b-1d239c7bf30d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114942025-01-09T01:44:25.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a70122e4-2942-4107-ac7b-1d239c7bf30d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114952025-01-09T01:44:26.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b951246-376c-4e64-9b51-8baed3decf63 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114962025-01-09T01:44:26.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b951246-376c-4e64-9b51-8baed3decf63 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114972025-01-09T01:44:26.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b951246-376c-4e64-9b51-8baed3decf63 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
114982025-01-09T01:44:26.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
114992025-01-09T01:44:26.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115002025-01-09T01:44:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115012025-01-09T01:44:26.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
115022025-01-09T01:44:26.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115032025-01-09T01:44:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115042025-01-09T01:44:26.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115052025-01-09T01:44:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115062025-01-09T01:44:26.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115072025-01-09T01:44:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115082025-01-09T01:44:26.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115092025-01-09T01:44:26.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115102025-01-09T01:44:26.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115112025-01-09T01:44:26.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
115122025-01-09T01:44:26.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115132025-01-09T01:44:26.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115142025-01-09T01:44:26.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
115152025-01-09T01:44:26.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.12135ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
115162025-01-09T01:44:26.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115172025-01-09T01:44:26.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115182025-01-09T01:44:26.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.003939ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115192025-01-09T01:44:27.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 682f1232-1a7a-405b-ab6b-1a74baa8eb87 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115202025-01-09T01:44:27.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 682f1232-1a7a-405b-ab6b-1a74baa8eb87 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115212025-01-09T01:44:27.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 682f1232-1a7a-405b-ab6b-1a74baa8eb87 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115222025-01-09T01:44:28.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = de291b0b-d25f-4031-9b54-c0b5d23f7080 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115232025-01-09T01:44:28.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = de291b0b-d25f-4031-9b54-c0b5d23f7080 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115242025-01-09T01:44:28.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = de291b0b-d25f-4031-9b54-c0b5d23f7080 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115252025-01-09T01:44:29.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 0778b7ee-76ed-450a-98dd-e2cdd2fb2f85 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
115262025-01-09T01:44:29.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 0778b7ee-76ed-450a-98dd-e2cdd2fb2f85 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
115272025-01-09T01:44:29.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 0778b7ee-76ed-450a-98dd-e2cdd2fb2f85 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
115282025-01-09T01:44:29.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 373b4865-dd2b-450b-8615-5c6126068591 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
115292025-01-09T01:44:29.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 373b4865-dd2b-450b-8615-5c6126068591 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
115302025-01-09T01:44:29.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 373b4865-dd2b-450b-8615-5c6126068591 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
115312025-01-09T01:44:29.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = ce55aeb9-9363-45f2-9ba8-a8fee7199676 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
115322025-01-09T01:44:29.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 246d3d55-43da-4326-af1d-d62bbc3a646a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115332025-01-09T01:44:29.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 246d3d55-43da-4326-af1d-d62bbc3a646a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115342025-01-09T01:44:29.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 246d3d55-43da-4326-af1d-d62bbc3a646a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115352025-01-09T01:44:30.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 677070e1-1c10-4ea1-999d-0d3cb490ef75 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115362025-01-09T01:44:30.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 677070e1-1c10-4ea1-999d-0d3cb490ef75 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115372025-01-09T01:44:30.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 677070e1-1c10-4ea1-999d-0d3cb490ef75 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115382025-01-09T01:44:31.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0536620b-b743-4ba7-a4a3-e6e7c5de4c2f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115392025-01-09T01:44:31.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0536620b-b743-4ba7-a4a3-e6e7c5de4c2f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115402025-01-09T01:44:31.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0536620b-b743-4ba7-a4a3-e6e7c5de4c2f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115412025-01-09T01:44:32.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dee0f3f4-26ea-488e-b37c-8c3c8670d547 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115422025-01-09T01:44:32.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dee0f3f4-26ea-488e-b37c-8c3c8670d547 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115432025-01-09T01:44:32.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dee0f3f4-26ea-488e-b37c-8c3c8670d547 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115442025-01-09T01:44:33.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 024cfcc6-f73b-4e5c-bf26-ce6005b8abe5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115452025-01-09T01:44:33.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 024cfcc6-f73b-4e5c-bf26-ce6005b8abe5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115462025-01-09T01:44:33.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 024cfcc6-f73b-4e5c-bf26-ce6005b8abe5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115472025-01-09T01:44:34.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30712d1a-d406-491e-9140-f2b6b873c5a2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115482025-01-09T01:44:34.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30712d1a-d406-491e-9140-f2b6b873c5a2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115492025-01-09T01:44:34.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 30712d1a-d406-491e-9140-f2b6b873c5a2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115502025-01-09T01:44:35.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 34a7fdd8-6f51-400e-be46-f68d7d269768 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115512025-01-09T01:44:35.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 34a7fdd8-6f51-400e-be46-f68d7d269768 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115522025-01-09T01:44:35.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 34a7fdd8-6f51-400e-be46-f68d7d269768 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115532025-01-09T01:44:36.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e6b81632-7dd0-4505-9297-6e843b6aa9eb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115542025-01-09T01:44:36.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e6b81632-7dd0-4505-9297-6e843b6aa9eb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115552025-01-09T01:44:36.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e6b81632-7dd0-4505-9297-6e843b6aa9eb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115562025-01-09T01:44:36.606ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
115572025-01-09T01:44:36.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115582025-01-09T01:44:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115592025-01-09T01:44:36.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
115602025-01-09T01:44:36.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115612025-01-09T01:44:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115622025-01-09T01:44:36.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115632025-01-09T01:44:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115642025-01-09T01:44:36.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115652025-01-09T01:44:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115662025-01-09T01:44:36.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115672025-01-09T01:44:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115682025-01-09T01:44:36.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115692025-01-09T01:44:36.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
115702025-01-09T01:44:36.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115712025-01-09T01:44:36.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115722025-01-09T01:44:36.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
115732025-01-09T01:44:36.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.455826ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
115742025-01-09T01:44:36.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115752025-01-09T01:44:36.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115762025-01-09T01:44:36.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.443754ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115772025-01-09T01:44:37.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f417c8c9-09ab-48ac-adb4-38d519db62ac roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115782025-01-09T01:44:37.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f417c8c9-09ab-48ac-adb4-38d519db62ac resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115792025-01-09T01:44:37.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f417c8c9-09ab-48ac-adb4-38d519db62ac response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115802025-01-09T01:44:38.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = df9db5b2-fa7c-42a4-b4f1-cfdac7185ea5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115812025-01-09T01:44:38.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = df9db5b2-fa7c-42a4-b4f1-cfdac7185ea5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115822025-01-09T01:44:38.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = df9db5b2-fa7c-42a4-b4f1-cfdac7185ea5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115832025-01-09T01:44:39.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = abb505b2-a883-4d02-8f0a-2d77aee18b2f response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
115842025-01-09T01:44:39.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e173e1a8-b3fc-487b-b19a-3ab8012172a8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115852025-01-09T01:44:39.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e173e1a8-b3fc-487b-b19a-3ab8012172a8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115862025-01-09T01:44:39.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e173e1a8-b3fc-487b-b19a-3ab8012172a8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115872025-01-09T01:44:40.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f78b7104-e256-4c99-8fe3-72bcd0ce69c0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115882025-01-09T01:44:40.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f78b7104-e256-4c99-8fe3-72bcd0ce69c0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115892025-01-09T01:44:40.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f78b7104-e256-4c99-8fe3-72bcd0ce69c0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115902025-01-09T01:44:41.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2ce55f4-c3b5-40e2-9137-9e205554ab4a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115912025-01-09T01:44:41.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2ce55f4-c3b5-40e2-9137-9e205554ab4a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115922025-01-09T01:44:41.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2ce55f4-c3b5-40e2-9137-9e205554ab4a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115932025-01-09T01:44:42.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5793cf82-fa84-4db5-b80f-37399a6eecbc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115942025-01-09T01:44:42.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5793cf82-fa84-4db5-b80f-37399a6eecbc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115952025-01-09T01:44:42.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5793cf82-fa84-4db5-b80f-37399a6eecbc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115962025-01-09T01:44:43.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c787ad5-99c1-44c7-9b82-27c52cdbaa26 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115972025-01-09T01:44:43.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c787ad5-99c1-44c7-9b82-27c52cdbaa26 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115982025-01-09T01:44:43.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c787ad5-99c1-44c7-9b82-27c52cdbaa26 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
115992025-01-09T01:44:44.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4864cb1a-c183-4826-99f1-c07f68190444 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
116002025-01-09T01:44:44.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4864cb1a-c183-4826-99f1-c07f68190444 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
116012025-01-09T01:44:44.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4864cb1a-c183-4826-99f1-c07f68190444 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
116022025-01-09T01:44:45.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 63c1468f-0b53-4b2e-91a9-62fa569d4cd1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
116032025-01-09T01:44:45.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 63c1468f-0b53-4b2e-91a9-62fa569d4cd1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
116042025-01-09T01:44:45.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 63c1468f-0b53-4b2e-91a9-62fa569d4cd1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
116052025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
116062025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
116072025-01-09T01:44:46.607ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
116082025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.09\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
116092025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
116102025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
116112025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
116122025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
116132025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
116142025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
116152025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
116162025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
116172025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116182025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
116192025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116202025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
116212025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116222025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
116232025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116242025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
116252025-01-09T01:44:46.607ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:34:46.607739647 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
116262025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
116272025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
116282025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
116292025-01-09T01:44:46.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
116302025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
116312025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
116322025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
116332025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116342025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116352025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
116362025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
116372025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116382025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
116392025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
116402025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116412025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
116422025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116432025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
116442025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
116452025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116462025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116472025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
116482025-01-09T01:44:46.608ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
116492025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116502025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116512025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
116522025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116532025-01-09T01:44:46.608ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
116542025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
116552025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
116562025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116572025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116582025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116592025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
116602025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116612025-01-09T01:44:46.608ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 5373907 } })
116622025-01-09T01:44:46.608ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 5377797 } })
116632025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
116642025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116652025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
116662025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116672025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116682025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116692025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116702025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116712025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116722025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116732025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116742025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116752025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
116762025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.24869ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
116772025-01-09T01:44:46.608ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
116782025-01-09T01:44:46.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.340951ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
116792025-01-09T01:44:46.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116802025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
116812025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
116822025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
116832025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
116842025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
116852025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116862025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
116872025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
116882025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116892025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116902025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
116912025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116922025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
116932025-01-09T01:44:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
116942025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
116952025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
116962025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
116972025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116982025-01-09T01:44:46.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 8111291 } })
116992025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
117002025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117012025-01-09T01:44:46.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
117022025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.851242ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117032025-01-09T01:44:46.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117042025-01-09T01:44:46.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117052025-01-09T01:44:46.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117062025-01-09T01:44:46.612ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:34:46.607739647 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
117072025-01-09T01:44:46.612ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.485583ms iteration = 12 status = {"expiration":"2025-01-09T01:34:46.607739647Z","pruned":[]}
117082025-01-09T01:44:46.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117092025-01-09T01:44:46.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 9458113 } })
117102025-01-09T01:44:46.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
117112025-01-09T01:44:46.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117122025-01-09T01:44:46.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117132025-01-09T01:44:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117142025-01-09T01:44:46.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117152025-01-09T01:44:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117162025-01-09T01:44:46.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117172025-01-09T01:44:46.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117182025-01-09T01:44:46.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117192025-01-09T01:44:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
117202025-01-09T01:44:46.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117212025-01-09T01:44:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117222025-01-09T01:44:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117232025-01-09T01:44:46.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117242025-01-09T01:44:46.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117252025-01-09T01:44:46.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117262025-01-09T01:44:46.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117272025-01-09T01:44:46.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117282025-01-09T01:44:46.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117292025-01-09T01:44:46.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117302025-01-09T01:44:46.621ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117312025-01-09T01:44:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117322025-01-09T01:44:46.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117332025-01-09T01:44:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117342025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117352025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117362025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117372025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117382025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
117392025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
117402025-01-09T01:44:46.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
117412025-01-09T01:44:46.624ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.469633ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
117422025-01-09T01:44:46.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117432025-01-09T01:44:46.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.425444ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
117442025-01-09T01:44:46.627ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
117452025-01-09T01:44:46.627ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
117462025-01-09T01:44:46.627ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
117472025-01-09T01:44:46.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117482025-01-09T01:44:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117492025-01-09T01:44:46.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117502025-01-09T01:44:46.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117512025-01-09T01:44:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117522025-01-09T01:44:46.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117532025-01-09T01:44:46.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117542025-01-09T01:44:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117552025-01-09T01:44:46.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117562025-01-09T01:44:46.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117572025-01-09T01:44:46.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117582025-01-09T01:44:46.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117592025-01-09T01:44:46.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117602025-01-09T01:44:46.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117612025-01-09T01:44:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117622025-01-09T01:44:46.635ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1619, tv_nsec: 32262720 } })
117632025-01-09T01:44:46.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117642025-01-09T01:44:46.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117652025-01-09T01:44:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117662025-01-09T01:44:46.635ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
117672025-01-09T01:44:46.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117682025-01-09T01:44:46.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117692025-01-09T01:44:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
117702025-01-09T01:44:46.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117712025-01-09T01:44:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117722025-01-09T01:44:46.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
117732025-01-09T01:44:46.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117742025-01-09T01:44:46.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117752025-01-09T01:44:46.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117762025-01-09T01:44:46.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117772025-01-09T01:44:46.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117782025-01-09T01:44:46.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117792025-01-09T01:44:46.658ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
117802025-01-09T01:44:46.658ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.528712ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
117812025-01-09T01:44:46.661ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117822025-01-09T01:44:46.661ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
117832025-01-09T01:44:46.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117842025-01-09T01:44:46.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117852025-01-09T01:44:46.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117862025-01-09T01:44:46.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.492454ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
117872025-01-09T01:44:46.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117882025-01-09T01:44:46.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117892025-01-09T01:44:46.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117902025-01-09T01:44:46.678ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
117912025-01-09T01:44:46.678ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
117922025-01-09T01:44:46.678ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.690545ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
117932025-01-09T01:44:46.682ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
117942025-01-09T01:44:46.682ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
117952025-01-09T01:44:46.682ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
117962025-01-09T01:44:46.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117972025-01-09T01:44:46.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117982025-01-09T01:44:46.683ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
117992025-01-09T01:44:46.683ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
118002025-01-09T01:44:46.683ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.842714ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
118012025-01-09T01:44:46.685ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118022025-01-09T01:44:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118032025-01-09T01:44:46.690ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118042025-01-09T01:44:46.690ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.855976ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118052025-01-09T01:44:46.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118062025-01-09T01:44:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118072025-01-09T01:44:46.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118082025-01-09T01:44:46.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118092025-01-09T01:44:46.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c7f49df-fb57-454c-8751-88cec10410b4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
118102025-01-09T01:44:46.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c7f49df-fb57-454c-8751-88cec10410b4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
118112025-01-09T01:44:46.695ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118122025-01-09T01:44:46.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
118132025-01-09T01:44:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118142025-01-09T01:44:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118152025-01-09T01:44:46.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118162025-01-09T01:44:46.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118172025-01-09T01:44:46.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118182025-01-09T01:44:46.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118192025-01-09T01:44:46.778ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
118202025-01-09T01:44:46.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118212025-01-09T01:44:46.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118222025-01-09T01:44:46.796ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118232025-01-09T01:44:46.796ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118242025-01-09T01:44:46.797ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56c5d757-12f9-4ed5-b1f5-0abeaac2dda6", "content-length": "26", "date": "Thu, 09 Jan 2025 01:44:46 GMT"} })
118252025-01-09T01:44:46.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118262025-01-09T01:44:46.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118272025-01-09T01:44:46.806ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118282025-01-09T01:44:46.806ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118292025-01-09T01:44:46.806ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7090b15-6e02-40e1-b508-5dbf9d81d401", "content-length": "26", "date": "Thu, 09 Jan 2025 01:44:46 GMT"} })
118302025-01-09T01:44:46.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118312025-01-09T01:44:46.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118322025-01-09T01:44:46.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
118332025-01-09T01:44:46.824ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118342025-01-09T01:44:46.824ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea03682e-4f95-4078-b31f-0846621c3ca9", "content-length": "26", "date": "Thu, 09 Jan 2025 01:44:46 GMT"} })
118352025-01-09T01:44:46.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118362025-01-09T01:44:46.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
118372025-01-09T01:44:46.916ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
118382025-01-09T01:44:47.059ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118392025-01-09T01:44:47.059ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118402025-01-09T01:44:47.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea6e88b7-19a1-4f43-a0a4-7ff9b785f361", "content-length": "372", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
118412025-01-09T01:44:47.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118422025-01-09T01:44:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118432025-01-09T01:44:47.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 453.594226ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118442025-01-09T01:44:47.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118452025-01-09T01:44:47.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118462025-01-09T01:44:47.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c7f49df-fb57-454c-8751-88cec10410b4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
118472025-01-09T01:44:47.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118482025-01-09T01:44:47.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118492025-01-09T01:44:47.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118502025-01-09T01:44:47.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118512025-01-09T01:44:47.092ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
118522025-01-09T01:44:47.092ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "17bdea8a-6ab2-4eac-8450-f76f6c6b03e3", "content-length": "1", "date": "Thu, 09 Jan 2025 01:44:46 GMT"} })
118532025-01-09T01:44:47.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 490.269106ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118542025-01-09T01:44:47.099ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118552025-01-09T01:44:47.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118562025-01-09T01:44:47.102ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
118572025-01-09T01:44:47.102ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c416badf-89c0-4f21-bef4-cd7a0ef0a735", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
118582025-01-09T01:44:47.103ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
118592025-01-09T01:44:47.103ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 495.571122ms iteration = 23 status = null
118602025-01-09T01:44:47.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "df941a2f-02b4-4141-a52d-2182af32fbe7", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
118612025-01-09T01:44:47.105ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
118622025-01-09T01:44:47.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118632025-01-09T01:44:47.106ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
118642025-01-09T01:44:47.106ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
118652025-01-09T01:44:47.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118662025-01-09T01:44:47.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118672025-01-09T01:44:47.107ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
118682025-01-09T01:44:47.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 499.880611ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
118692025-01-09T01:44:47.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118702025-01-09T01:44:47.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118712025-01-09T01:44:47.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118722025-01-09T01:44:47.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118732025-01-09T01:44:47.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118742025-01-09T01:44:47.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118752025-01-09T01:44:47.110ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118762025-01-09T01:44:47.110ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118772025-01-09T01:44:47.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118782025-01-09T01:44:47.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118792025-01-09T01:44:47.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118802025-01-09T01:44:47.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 501.66112ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118812025-01-09T01:44:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118822025-01-09T01:44:47.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118832025-01-09T01:44:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118842025-01-09T01:44:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
118852025-01-09T01:44:47.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118862025-01-09T01:44:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118872025-01-09T01:44:47.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118882025-01-09T01:44:47.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118892025-01-09T01:44:47.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118902025-01-09T01:44:47.118ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 509.273682ms iteration = 23 status = 0
118912025-01-09T01:44:47.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118922025-01-09T01:44:47.119ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
118932025-01-09T01:44:47.119ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
118942025-01-09T01:44:47.119ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
118952025-01-09T01:44:47.119ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 511.790583ms iteration = 12 status = {"generation":2}
118962025-01-09T01:44:47.128ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118972025-01-09T01:44:47.130ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118982025-01-09T01:44:47.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118992025-01-09T01:44:47.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119002025-01-09T01:44:47.131ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
119012025-01-09T01:44:47.131ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119022025-01-09T01:44:47.131ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "af813ed1-039a-45d5-95af-6e0d71dea3bd", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119032025-01-09T01:44:47.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119042025-01-09T01:44:47.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119052025-01-09T01:44:47.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119062025-01-09T01:44:47.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119072025-01-09T01:44:47.135ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 528.002104ms iteration = 23 status = {}
119082025-01-09T01:44:47.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119092025-01-09T01:44:47.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119102025-01-09T01:44:47.139ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119112025-01-09T01:44:47.139ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119122025-01-09T01:44:47.139ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a7151c67-9b96-4af1-8ad1-50b3419dc69f", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119132025-01-09T01:44:47.141ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 532.703168ms iteration = 23 status = {}
119142025-01-09T01:44:47.142ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
119152025-01-09T01:44:47.142ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
119162025-01-09T01:44:47.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119172025-01-09T01:44:47.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119182025-01-09T01:44:47.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 544.067252ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
119192025-01-09T01:44:47.157ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119202025-01-09T01:44:47.157ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
119212025-01-09T01:44:47.157ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 549.666391ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
119222025-01-09T01:44:47.173ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
119232025-01-09T01:44:47.173ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
119242025-01-09T01:44:47.173ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 565.911333ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
119252025-01-09T01:44:47.179ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 571.238209ms iteration = 26 status = {"physical_disks_added":0}
119262025-01-09T01:44:47.185ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
119272025-01-09T01:44:47.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 577.604232ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
119282025-01-09T01:44:47.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119292025-01-09T01:44:47.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119302025-01-09T01:44:47.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119312025-01-09T01:44:47.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119322025-01-09T01:44:47.196ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
119332025-01-09T01:44:47.196ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
119342025-01-09T01:44:47.196ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
119352025-01-09T01:44:47.196ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 589.108376ms iteration = 12 status = {"generation":1}
119362025-01-09T01:44:47.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119372025-01-09T01:44:47.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119382025-01-09T01:44:47.241ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
119392025-01-09T01:44:47.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119402025-01-09T01:44:47.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119412025-01-09T01:44:47.256ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
119422025-01-09T01:44:47.256ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "010065b9-9f2f-44f7-8d66-5066eb69afd2", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119432025-01-09T01:44:47.256ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119442025-01-09T01:44:47.258ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6a4a6f04-5800-4064-a291-9ba5f2378789", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119452025-01-09T01:44:47.258ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119462025-01-09T01:44:47.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ec30f323-f8c1-422a-beec-9caadb5ea495", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119472025-01-09T01:44:47.260ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119482025-01-09T01:44:47.262ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119492025-01-09T01:44:47.262ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 654.762993ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
119502025-01-09T01:44:47.267ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119512025-01-09T01:44:47.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d74a084d-1cce-4104-ad12-bcd0176c0577", "content-length": "691", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119522025-01-09T01:44:47.268ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119532025-01-09T01:44:47.268ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119542025-01-09T01:44:47.268ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119552025-01-09T01:44:47.268ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 660.79242ms iteration = 23 status = {}
119562025-01-09T01:44:47.276ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119572025-01-09T01:44:47.276ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "776abca6-efc1-4d30-bfa9-234906d3eeac", "content-length": "134", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119582025-01-09T01:44:47.276ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119592025-01-09T01:44:47.276ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
119602025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119612025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119622025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119632025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119642025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119652025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119662025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119672025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119682025-01-09T01:44:47.277ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
119692025-01-09T01:44:47.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119702025-01-09T01:44:47.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119712025-01-09T01:44:47.280ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119722025-01-09T01:44:47.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "29e111e5-eaab-48ec-b545-26372b788abe", "content-length": "2", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119732025-01-09T01:44:47.280ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119742025-01-09T01:44:47.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8fe1acf-595b-4a63-b62d-ac2b69d87c44", "content-length": "52", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119752025-01-09T01:44:47.280ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
119762025-01-09T01:44:47.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119772025-01-09T01:44:47.386ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "58a0dcb5-4d81-4f9d-b7a5-93ba53381fa3", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119782025-01-09T01:44:47.386ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
119792025-01-09T01:44:47.386ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119802025-01-09T01:44:47.386ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb3fa460-53d8-4e78-8d77-3bf9a6ffa681", "content-length": "682", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
119812025-01-09T01:44:47.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119822025-01-09T01:44:47.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119832025-01-09T01:44:47.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119842025-01-09T01:44:47.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119852025-01-09T01:44:47.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119862025-01-09T01:44:47.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119872025-01-09T01:44:47.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119882025-01-09T01:44:47.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119892025-01-09T01:44:47.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b60d6445-864f-4a1e-b4fd-db6733d64a80 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
119902025-01-09T01:44:47.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b60d6445-864f-4a1e-b4fd-db6733d64a80 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
119912025-01-09T01:44:47.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b60d6445-864f-4a1e-b4fd-db6733d64a80 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
119922025-01-09T01:44:47.404ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 796.562154ms iteration = 23 status = {}
119932025-01-09T01:44:47.416ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
119942025-01-09T01:44:47.416ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
119952025-01-09T01:44:47.449ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
119962025-01-09T01:44:47.450ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42510
119972025-01-09T01:44:47.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42510 req_id = 75a0addc-b30b-480c-b686-55c0e19c9e39 roles = RoleSet { roles: {} } uri = /metrics/producers
119982025-01-09T01:44:47.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42510 req_id = 75a0addc-b30b-480c-b686-55c0e19c9e39 resource = Database result = Ok(()) uri = /metrics/producers
119992025-01-09T01:44:47.491ZINFOnexus: assigned collector to new producer collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:76 producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
120002025-01-09T01:44:47.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41396 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42510 req_id = 75a0addc-b30b-480c-b686-55c0e19c9e39 response_code = 201 uri = /metrics/producers
120012025-01-09T01:44:47.491ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "75a0addc-b30b-480c-b686-55c0e19c9e39", "content-length": "41", "date": "Thu, 09 Jan 2025 01:44:47 GMT"} })
120022025-01-09T01:44:47.493ZDEBGnexus (producer-registration-task): registered with nexus successfully
120032025-01-09T01:44:47.493ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
120042025-01-09T01:44:48.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0840f64f-5fcf-48e4-997d-3c2756f21dcb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120052025-01-09T01:44:48.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0840f64f-5fcf-48e4-997d-3c2756f21dcb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120062025-01-09T01:44:48.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0840f64f-5fcf-48e4-997d-3c2756f21dcb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120072025-01-09T01:44:49.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 457ae967-fee2-4d65-980e-347b4ebaea47 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120082025-01-09T01:44:49.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 457ae967-fee2-4d65-980e-347b4ebaea47 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120092025-01-09T01:44:49.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 457ae967-fee2-4d65-980e-347b4ebaea47 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120102025-01-09T01:44:49.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 619 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 61b26792-21f0-41c1-ae2b-013c018639f2 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
120112025-01-09T01:44:50.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e5da5d0-d8f7-4e81-85ec-b487f477469a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120122025-01-09T01:44:50.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e5da5d0-d8f7-4e81-85ec-b487f477469a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120132025-01-09T01:44:50.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e5da5d0-d8f7-4e81-85ec-b487f477469a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120142025-01-09T01:44:51.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd69ddb2-690c-4a5e-b3f4-232c9207533f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120152025-01-09T01:44:51.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd69ddb2-690c-4a5e-b3f4-232c9207533f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120162025-01-09T01:44:51.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd69ddb2-690c-4a5e-b3f4-232c9207533f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120172025-01-09T01:44:52.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6f1eb09f-a082-4c6d-89c5-a81318d120bf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120182025-01-09T01:44:52.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6f1eb09f-a082-4c6d-89c5-a81318d120bf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120192025-01-09T01:44:52.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6f1eb09f-a082-4c6d-89c5-a81318d120bf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120202025-01-09T01:44:53.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0a4d43c-6b93-4c1e-925d-2a8d0853bf13 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120212025-01-09T01:44:53.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0a4d43c-6b93-4c1e-925d-2a8d0853bf13 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120222025-01-09T01:44:53.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0a4d43c-6b93-4c1e-925d-2a8d0853bf13 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120232025-01-09T01:44:54.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae947672-6252-419c-bdb6-6fa36cf93472 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120242025-01-09T01:44:54.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae947672-6252-419c-bdb6-6fa36cf93472 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120252025-01-09T01:44:54.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ae947672-6252-419c-bdb6-6fa36cf93472 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120262025-01-09T01:44:55.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69fa913c-1fe1-4d7f-ae11-4eea68095f8a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120272025-01-09T01:44:55.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69fa913c-1fe1-4d7f-ae11-4eea68095f8a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120282025-01-09T01:44:55.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 69fa913c-1fe1-4d7f-ae11-4eea68095f8a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120292025-01-09T01:44:56.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 770ed975-4322-4e83-87dc-850bbec707f0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120302025-01-09T01:44:56.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 770ed975-4322-4e83-87dc-850bbec707f0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120312025-01-09T01:44:56.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 770ed975-4322-4e83-87dc-850bbec707f0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120322025-01-09T01:44:56.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
120332025-01-09T01:44:56.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120342025-01-09T01:44:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120352025-01-09T01:44:56.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
120362025-01-09T01:44:56.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120372025-01-09T01:44:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120382025-01-09T01:44:56.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120392025-01-09T01:44:56.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120402025-01-09T01:44:56.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120412025-01-09T01:44:56.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120422025-01-09T01:44:56.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120432025-01-09T01:44:56.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120442025-01-09T01:44:56.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120452025-01-09T01:44:56.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120462025-01-09T01:44:56.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120472025-01-09T01:44:56.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
120482025-01-09T01:44:56.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120492025-01-09T01:44:56.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120502025-01-09T01:44:56.660ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
120512025-01-09T01:44:56.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.730849ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
120522025-01-09T01:44:56.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.222537ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120532025-01-09T01:44:57.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 55abcd2a-2f23-483c-b2f5-c5988bd19dc5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120542025-01-09T01:44:57.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 55abcd2a-2f23-483c-b2f5-c5988bd19dc5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120552025-01-09T01:44:57.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 55abcd2a-2f23-483c-b2f5-c5988bd19dc5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120562025-01-09T01:44:58.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 10a6a184-de18-495b-98d9-6cd8946ab974 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120572025-01-09T01:44:58.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 10a6a184-de18-495b-98d9-6cd8946ab974 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120582025-01-09T01:44:58.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 10a6a184-de18-495b-98d9-6cd8946ab974 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120592025-01-09T01:44:59.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 509 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 252886c0-6a86-4fee-a507-c11154b70433 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
120602025-01-09T01:44:59.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3b6df32-2300-4691-bd8b-4a00271ee153 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120612025-01-09T01:44:59.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3b6df32-2300-4691-bd8b-4a00271ee153 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120622025-01-09T01:44:59.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3b6df32-2300-4691-bd8b-4a00271ee153 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120632025-01-09T01:45:00.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a32fbeb0-c642-4933-a3a0-c8fba01d2999 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120642025-01-09T01:45:00.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a32fbeb0-c642-4933-a3a0-c8fba01d2999 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
120652025-01-09T01:45:00.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a32fbeb0-c642-4933-a3a0-c8fba01d2999 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7