Max level shown:
1 [ Jan 9 01:03:34 Enabled. ]
2 [ Jan 9 01:03:34 Rereading configuration. ]
3 [ Jan 9 01:03:35 Rereading configuration. ]
4 [ Jan 9 01:03:42 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Jan 9 01:03:42 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-01-09T01:03:42.372ZDEBGnexus: registered DTrace probes
82025-01-09T01:03:42.375ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292025-01-09T01:03:42.381ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612025-01-09T01:03:42.382ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622025-01-09T01:03:42.382ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632025-01-09T01:03:42.405ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642025-01-09T01:03:42.407ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652025-01-09T01:03:42.411ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662025-01-09T01:03:42.416ZDEBGnexus (ServerContext): registered USDT probes
672025-01-09T01:03:42.490ZINFOnexus: Database schema version is up to date desired_version = 119.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 119.0.0
682025-01-09T01:03:42.493ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
692025-01-09T01:03:42.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 957495492 } })
702025-01-09T01:03:42.498ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712025-01-09T01:03:42.549ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722025-01-09T01:03:42.549ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732025-01-09T01:03:42.552ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98a263ca-d603-47c0-9af6-c31da27a140e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:03:42 GMT"} })
742025-01-09T01:03:42.552ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752025-01-09T01:03:42.552ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762025-01-09T01:03:42.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1066, tv_nsec: 44940105 } })
772025-01-09T01:03:42.583ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782025-01-09T01:03:42.616ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792025-01-09T01:03:42.616ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802025-01-09T01:03:42.616ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbfadecf-18c0-4a06-91fc-c1935762710b", "content-length": "26", "date": "Thu, 09 Jan 2025 01:03:42 GMT"} })
812025-01-09T01:03:42.616ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822025-01-09T01:03:42.617ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832025-01-09T01:03:42.687ZDEBGnexus (clickhouse-client): registered USDT probes id = f78e3042-c6d4-4657-bcdf-80ce72b8529f
842025-01-09T01:03:42.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852025-01-09T01:03:42.729ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862025-01-09T01:03:42.730ZDEBGnexus (DataLoader): attempting to create built-in users
872025-01-09T01:03:42.730ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882025-01-09T01:03:42.731ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
912025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
922025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
942025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
952025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1012025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1032025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1062025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1082025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1092025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1122025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1142025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1162025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1182025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1192025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1212025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1222025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1262025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1272025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1282025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1292025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312025-01-09T01:03:42.747ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1322025-01-09T01:03:42.747ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1332025-01-09T01:03:42.747ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342025-01-09T01:03:42.748ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352025-01-09T01:03:42.844ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1362025-01-09T01:03:42.844ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372025-01-09T01:03:42.846ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382025-01-09T01:03:42.846ZDEBGnexus (DataLoader): attempting to create built-in roles
1392025-01-09T01:03:42.847ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402025-01-09T01:03:42.847ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412025-01-09T01:03:42.938ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1422025-01-09T01:03:42.938ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432025-01-09T01:03:42.939ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442025-01-09T01:03:42.939ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1452025-01-09T01:03:42.939ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462025-01-09T01:03:42.939ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472025-01-09T01:03:42.978ZWARNnexus: Cannot look up rack: Object (of type ById(122d04f2-96f1-44ac-9122-b16b480179a5)) not found: rack file = nexus/src/app/rack.rs:774
1482025-01-09T01:03:43.022ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49206
1492025-01-09T01:03:43.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49206 req_id = c1dc0058-ad1b-4200-bb25-5b0148a269aa roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1502025-01-09T01:03:43.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49206 req_id = c1dc0058-ad1b-4200-bb25-5b0148a269aa resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1512025-01-09T01:03:43.085ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49357
1522025-01-09T01:03:43.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9347541-c206-4d8f-839c-d890e1303037 roles = RoleSet { roles: {} } uri = /sled-agents/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1532025-01-09T01:03:43.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9347541-c206-4d8f-839c-d890e1303037 resource = Database result = Ok(()) uri = /sled-agents/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1542025-01-09T01:03:43.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49206 req_id = c1dc0058-ad1b-4200-bb25-5b0148a269aa response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1552025-01-09T01:03:43.182ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a" error_message_internal = not found: sled with id "66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 96284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9347541-c206-4d8f-839c-d890e1303037 response_code = 404 uri = /sled-agents/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1562025-01-09T01:03:43.936ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1572025-01-09T01:03:43.936ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582025-01-09T01:03:43.937ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592025-01-09T01:03:43.937ZDEBGnexus (DataLoader): attempting to create built-in silos
1602025-01-09T01:03:43.937ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612025-01-09T01:03:43.937ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622025-01-09T01:03:44.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4bf36ca1-cb33-4dfa-a63b-79c86ebef76e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1632025-01-09T01:03:44.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4bf36ca1-cb33-4dfa-a63b-79c86ebef76e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1642025-01-09T01:03:44.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4bf36ca1-cb33-4dfa-a63b-79c86ebef76e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1652025-01-09T01:03:44.766ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1662025-01-09T01:03:44.766ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672025-01-09T01:03:44.766ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682025-01-09T01:03:44.772ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692025-01-09T01:03:44.773ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702025-01-09T01:03:44.773ZDEBGnexus (DataLoader): attempting to create built-in projects
1712025-01-09T01:03:44.773ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722025-01-09T01:03:44.773ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732025-01-09T01:03:44.795ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742025-01-09T01:03:44.795ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752025-01-09T01:03:44.851ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762025-01-09T01:03:44.852ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772025-01-09T01:03:44.854ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782025-01-09T01:03:44.856ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1792025-01-09T01:03:44.856ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802025-01-09T01:03:44.856ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812025-01-09T01:03:44.979ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1822025-01-09T01:03:44.979ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1832025-01-09T01:03:44.980ZWARNnexus: Cannot look up rack: Object (of type ById(122d04f2-96f1-44ac-9122-b16b480179a5)) not found: rack file = nexus/src/app/rack.rs:774
1842025-01-09T01:03:45.090ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:56 sled_uuid = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1852025-01-09T01:03:45.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49206 req_id = 4cd53890-68cc-4dfe-a816-5956f8c265d4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1862025-01-09T01:03:45.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49206 req_id = 4cd53890-68cc-4dfe-a816-5956f8c265d4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1872025-01-09T01:03:45.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49206 req_id = 4cd53890-68cc-4dfe-a816-5956f8c265d4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1882025-01-09T01:03:45.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185374 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dbd330d0-e271-4bb1-bd4e-c8a54eb56ed0 response_code = 204 uri = /sled-agents/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
1892025-01-09T01:03:45.288ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902025-01-09T01:03:45.289ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912025-01-09T01:03:45.321ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922025-01-09T01:03:45.323ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1932025-01-09T01:03:45.323ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942025-01-09T01:03:45.323ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952025-01-09T01:03:45.453ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1962025-01-09T01:03:45.453ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972025-01-09T01:03:45.454ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982025-01-09T01:03:45.454ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1992025-01-09T01:03:45.454ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002025-01-09T01:03:45.454ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012025-01-09T01:03:45.468ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022025-01-09T01:03:45.468ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032025-01-09T01:03:45.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042025-01-09T01:03:45.514ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052025-01-09T01:03:45.516ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062025-01-09T01:03:45.516ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072025-01-09T01:03:45.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082025-01-09T01:03:45.517ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092025-01-09T01:03:45.518ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102025-01-09T01:03:45.521ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2112025-01-09T01:03:45.521ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122025-01-09T01:03:45.521ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132025-01-09T01:03:45.522ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142025-01-09T01:03:45.522ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152025-01-09T01:03:45.523ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162025-01-09T01:03:45.524ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172025-01-09T01:03:45.553ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182025-01-09T01:03:45.555ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2192025-01-09T01:03:45.555ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202025-01-09T01:03:45.556ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212025-01-09T01:03:45.614ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222025-01-09T01:03:45.615ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232025-01-09T01:03:45.616ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242025-01-09T01:03:45.616ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252025-01-09T01:03:45.617ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262025-01-09T01:03:45.618ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272025-01-09T01:03:45.619ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282025-01-09T01:03:45.622ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2292025-01-09T01:03:45.622ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302025-01-09T01:03:45.622ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312025-01-09T01:03:45.640ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322025-01-09T01:03:45.640ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332025-01-09T01:03:45.680ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342025-01-09T01:03:45.680ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352025-01-09T01:03:45.700ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362025-01-09T01:03:45.700ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372025-01-09T01:03:45.745ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382025-01-09T01:03:45.746ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392025-01-09T01:03:45.747ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402025-01-09T01:03:45.748ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412025-01-09T01:03:45.749ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422025-01-09T01:03:45.752ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2432025-01-09T01:03:45.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442025-01-09T01:03:45.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452025-01-09T01:03:45.805ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462025-01-09T01:03:45.805ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472025-01-09T01:03:45.806ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482025-01-09T01:03:45.806ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492025-01-09T01:03:45.808ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502025-01-09T01:03:45.808ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512025-01-09T01:03:45.809ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522025-01-09T01:03:45.812ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2532025-01-09T01:03:45.812ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542025-01-09T01:03:45.812ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552025-01-09T01:03:45.872ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562025-01-09T01:03:45.872ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572025-01-09T01:03:45.874ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582025-01-09T01:03:45.874ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592025-01-09T01:03:45.875ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602025-01-09T01:03:45.875ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612025-01-09T01:03:45.877ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622025-01-09T01:03:45.880ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2632025-01-09T01:03:45.880ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642025-01-09T01:03:45.880ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652025-01-09T01:03:45.950ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2662025-01-09T01:03:45.950ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672025-01-09T01:03:45.950ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682025-01-09T01:03:45.952ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692025-01-09T01:03:45.953ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702025-01-09T01:03:45.954ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712025-01-09T01:03:45.955ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722025-01-09T01:03:45.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732025-01-09T01:03:45.957ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742025-01-09T01:03:45.962ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752025-01-09T01:03:45.963ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762025-01-09T01:03:45.964ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772025-01-09T01:03:45.964ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782025-01-09T01:03:45.965ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792025-01-09T01:03:45.968ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2802025-01-09T01:03:45.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812025-01-09T01:03:45.968ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822025-01-09T01:03:45.969ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832025-01-09T01:03:45.969ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842025-01-09T01:03:45.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852025-01-09T01:03:45.971ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862025-01-09T01:03:45.972ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872025-01-09T01:03:45.975ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2882025-01-09T01:03:45.975ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892025-01-09T01:03:45.975ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902025-01-09T01:03:46.003ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912025-01-09T01:03:46.003ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922025-01-09T01:03:46.004ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932025-01-09T01:03:46.005ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942025-01-09T01:03:46.006ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952025-01-09T01:03:46.006ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962025-01-09T01:03:46.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972025-01-09T01:03:46.010ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2982025-01-09T01:03:46.010ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992025-01-09T01:03:46.010ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002025-01-09T01:03:46.247ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:165 retry_after (ms) = 34 transaction = vpc_update_firewall_rules
3012025-01-09T01:03:46.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6dbcbbc-bda6-4659-bab4-63b167b7e81e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
3022025-01-09T01:03:46.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6dbcbbc-bda6-4659-bab4-63b167b7e81e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
3032025-01-09T01:03:46.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6dbcbbc-bda6-4659-bab4-63b167b7e81e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
3042025-01-09T01:03:46.319ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:121 transaction = vpc_update_firewall_rules
3052025-01-09T01:03:46.319ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
3062025-01-09T01:03:46.319ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3072025-01-09T01:03:46.319ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082025-01-09T01:03:46.320ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092025-01-09T01:03:46.330ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102025-01-09T01:03:46.330ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112025-01-09T01:03:46.331ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122025-01-09T01:03:46.331ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132025-01-09T01:03:46.333ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142025-01-09T01:03:46.333ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152025-01-09T01:03:46.334ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162025-01-09T01:03:46.334ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172025-01-09T01:03:46.336ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182025-01-09T01:03:46.336ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192025-01-09T01:03:46.337ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202025-01-09T01:03:46.340ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3212025-01-09T01:03:46.340ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222025-01-09T01:03:46.340ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232025-01-09T01:03:46.341ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242025-01-09T01:03:46.342ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252025-01-09T01:03:46.343ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262025-01-09T01:03:46.343ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272025-01-09T01:03:46.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282025-01-09T01:03:46.345ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292025-01-09T01:03:46.346ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302025-01-09T01:03:46.346ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312025-01-09T01:03:46.347ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322025-01-09T01:03:46.347ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332025-01-09T01:03:46.348ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342025-01-09T01:03:46.348ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352025-01-09T01:03:46.349ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362025-01-09T01:03:46.353ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3372025-01-09T01:03:46.353ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382025-01-09T01:03:46.353ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392025-01-09T01:03:46.365ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402025-01-09T01:03:46.365ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3412025-01-09T01:03:46.366ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422025-01-09T01:03:46.367ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432025-01-09T01:03:46.367ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442025-01-09T01:03:46.368ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3452025-01-09T01:03:46.369ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462025-01-09T01:03:46.371ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3472025-01-09T01:03:46.395ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482025-01-09T01:03:46.395ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492025-01-09T01:03:46.453ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502025-01-09T01:03:46.453ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512025-01-09T01:03:46.460ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522025-01-09T01:03:46.460ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532025-01-09T01:03:46.461ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542025-01-09T01:03:46.462ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552025-01-09T01:03:46.463ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562025-01-09T01:03:46.463ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3572025-01-09T01:03:46.464ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582025-01-09T01:03:46.468ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3592025-01-09T01:03:46.468ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602025-01-09T01:03:46.468ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612025-01-09T01:03:46.495ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622025-01-09T01:03:46.495ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632025-01-09T01:03:46.497ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642025-01-09T01:03:46.497ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652025-01-09T01:03:46.499ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662025-01-09T01:03:46.499ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672025-01-09T01:03:46.500ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682025-01-09T01:03:46.500ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3692025-01-09T01:03:46.501ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702025-01-09T01:03:46.502ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3712025-01-09T01:03:46.503ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722025-01-09T01:03:46.503ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732025-01-09T01:03:46.507ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3742025-01-09T01:03:46.507ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3752025-01-09T01:03:46.508ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762025-01-09T01:03:46.512ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3772025-01-09T01:03:46.512ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3782025-01-09T01:03:46.512ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3792025-01-09T01:03:46.512ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802025-01-09T01:03:46.513ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3812025-01-09T01:03:46.513ZDEBGnexus (DataLoader): attempting to create silo users
3822025-01-09T01:03:46.513ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3832025-01-09T01:03:46.513ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3842025-01-09T01:03:46.531ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3852025-01-09T01:03:46.531ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3862025-01-09T01:03:46.531ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3872025-01-09T01:03:46.531ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3882025-01-09T01:03:46.536ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3892025-01-09T01:03:46.536ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3902025-01-09T01:03:46.536ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3912025-01-09T01:03:46.553ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3922025-01-09T01:03:46.553ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3932025-01-09T01:03:46.561ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942025-01-09T01:03:46.562ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952025-01-09T01:03:46.563ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3962025-01-09T01:03:46.564ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3972025-01-09T01:03:46.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3982025-01-09T01:03:46.564ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3992025-01-09T01:03:46.582ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002025-01-09T01:03:46.582ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4012025-01-09T01:03:46.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4022025-01-09T01:03:46.584ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4032025-01-09T01:03:46.584ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4042025-01-09T01:03:46.584ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4052025-01-09T01:03:46.871ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4062025-01-09T01:03:46.872ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4072025-01-09T01:03:46.891ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
4082025-01-09T01:03:46.891ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
4092025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Signaled
4102025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4112025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4122025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4132025-01-09T01:03:46.898ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4142025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4152025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4162025-01-09T01:03:46.898ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4172025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4182025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4192025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 26.85\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4202025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 58.511\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4212025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4222025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4232025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4242025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4252025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4262025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4272025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4282025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4292025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4302025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4312025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4322025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4332025-01-09T01:03:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4342025-01-09T01:03:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:53:46.899081974 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4352025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4362025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4372025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4382025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4392025-01-09T01:03:46.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4402025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.42\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4412025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4422025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4432025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4442025-01-09T01:03:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4452025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4462025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4472025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4482025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4492025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4502025-01-09T01:03:46.900ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4512025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4522025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4532025-01-09T01:03:46.900ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4542025-01-09T01:03:46.901ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4552025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4562025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4572025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4582025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4592025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4602025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4612025-01-09T01:03:46.901ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4622025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4632025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4642025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4652025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4662025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4672025-01-09T01:03:46.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4682025-01-09T01:03:46.903ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4692025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 3.53892ms iteration = 1 status = {"error":"no blueprint"}
4702025-01-09T01:03:46.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4712025-01-09T01:03:46.904ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 365203397 } })
4722025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4732025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4742025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4752025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4762025-01-09T01:03:46.904ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 365534015 } })
4772025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4782025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4792025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4802025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4812025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4822025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4832025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4842025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4852025-01-09T01:03:46.904ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4862025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4872025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4882025-01-09T01:03:46.904ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4892025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4902025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4912025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4922025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4932025-01-09T01:03:46.904ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4942025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4952025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.572718ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4962025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4972025-01-09T01:03:46.904ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4982025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.06\u{b5}s iteration = 2 status = {"error":"no config"}
4992025-01-09T01:03:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5002025-01-09T01:03:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5012025-01-09T01:03:46.905ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5022025-01-09T01:03:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.296404ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5032025-01-09T01:03:46.905ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5042025-01-09T01:03:46.905ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5052025-01-09T01:03:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 5.951\u{b5}s iteration = 2 status = {"error":"no config"}
5062025-01-09T01:03:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5072025-01-09T01:03:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5082025-01-09T01:03:46.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 367589341 } })
5092025-01-09T01:03:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5102025-01-09T01:03:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5112025-01-09T01:03:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5122025-01-09T01:03:46.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5132025-01-09T01:03:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5142025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5152025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5162025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5172025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5182025-01-09T01:03:46.907ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5192025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5202025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5212025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5222025-01-09T01:03:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5232025-01-09T01:03:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5242025-01-09T01:03:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5252025-01-09T01:03:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5262025-01-09T01:03:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5272025-01-09T01:03:46.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282025-01-09T01:03:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5292025-01-09T01:03:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5302025-01-09T01:03:46.909ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5312025-01-09T01:03:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5322025-01-09T01:03:46.909ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.330843ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5332025-01-09T01:03:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5342025-01-09T01:03:46.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5352025-01-09T01:03:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5362025-01-09T01:03:46.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5372025-01-09T01:03:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5382025-01-09T01:03:46.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5392025-01-09T01:03:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5402025-01-09T01:03:46.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5412025-01-09T01:03:46.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5422025-01-09T01:03:46.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5432025-01-09T01:03:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5442025-01-09T01:03:46.921ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.696ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5452025-01-09T01:03:46.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5462025-01-09T01:03:46.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5472025-01-09T01:03:46.924ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 385948925 } })
5482025-01-09T01:03:46.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492025-01-09T01:03:46.925ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5502025-01-09T01:03:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5512025-01-09T01:03:46.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5522025-01-09T01:03:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5532025-01-09T01:03:46.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542025-01-09T01:03:46.930ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:53:46.899081974 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5552025-01-09T01:03:46.930ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 32.429751ms iteration = 1 status = {"expiration":"2025-01-09T00:53:46.899081974Z","pruned":[]}
5562025-01-09T01:03:46.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5572025-01-09T01:03:46.933ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5582025-01-09T01:03:46.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5592025-01-09T01:03:46.963ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5602025-01-09T01:03:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.24377ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5612025-01-09T01:03:46.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622025-01-09T01:03:46.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5632025-01-09T01:03:46.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642025-01-09T01:03:46.973ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652025-01-09T01:03:46.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662025-01-09T01:03:46.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5672025-01-09T01:03:46.973ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5682025-01-09T01:03:46.974ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7dc6635-8b10-448a-baaf-87481eafe6d0", "content-length": "26", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
5692025-01-09T01:03:46.975ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5702025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.516427ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5712025-01-09T01:03:46.976ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5722025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5732025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5742025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5752025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5762025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5772025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5782025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5792025-01-09T01:03:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5802025-01-09T01:03:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5812025-01-09T01:03:46.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5822025-01-09T01:03:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5832025-01-09T01:03:46.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.937754ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
5842025-01-09T01:03:46.979ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 80.097467ms iteration = 1 status = {}
5852025-01-09T01:03:46.980ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5862025-01-09T01:03:46.980ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5872025-01-09T01:03:46.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5882025-01-09T01:03:46.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5892025-01-09T01:03:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5902025-01-09T01:03:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5912025-01-09T01:03:46.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922025-01-09T01:03:46.981ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
5932025-01-09T01:03:46.981ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.857126ms iteration = 1 status = {"error":"rack not yet initialized: 122d04f2-96f1-44ac-9122-b16b480179a5"}
5942025-01-09T01:03:46.982ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
5952025-01-09T01:03:46.982ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
5962025-01-09T01:03:46.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5972025-01-09T01:03:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5982025-01-09T01:03:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5992025-01-09T01:03:46.984ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6002025-01-09T01:03:46.984ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6012025-01-09T01:03:46.985ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6022025-01-09T01:03:46.985ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6032025-01-09T01:03:46.985ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 86.282516ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6042025-01-09T01:03:46.986ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 447698259 } })
6052025-01-09T01:03:46.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6062025-01-09T01:03:46.987ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072025-01-09T01:03:46.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6082025-01-09T01:03:46.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092025-01-09T01:03:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6102025-01-09T01:03:46.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6112025-01-09T01:03:46.993ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 122d04f2-96f1-44ac-9122-b16b480179a5, lookup_type: ById(122d04f2-96f1-44ac-9122-b16b480179a5) } result = Ok(())
6122025-01-09T01:03:46.993ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 122d04f2-96f1-44ac-9122-b16b480179a5, time_created: 2025-01-09T01:03:46.553101Z, time_modified: 2025-01-09T01:03:46.553101Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
6132025-01-09T01:03:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6142025-01-09T01:03:46.996ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6152025-01-09T01:03:46.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6162025-01-09T01:03:46.997ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6172025-01-09T01:03:46.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6182025-01-09T01:03:46.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192025-01-09T01:03:46.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6202025-01-09T01:03:46.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6212025-01-09T01:03:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6222025-01-09T01:03:47.003ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6232025-01-09T01:03:47.003ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6242025-01-09T01:03:47.003ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4980c5e7-cdb1-448c-a40b-d4c0cefd4298", "content-length": "26", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6252025-01-09T01:03:47.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6262025-01-09T01:03:47.004ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
6272025-01-09T01:03:47.004ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.418886ms iteration = 1 status = {"error":"inventory collection is None"}
6282025-01-09T01:03:47.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6292025-01-09T01:03:47.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6302025-01-09T01:03:47.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6312025-01-09T01:03:47.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322025-01-09T01:03:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6332025-01-09T01:03:47.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6342025-01-09T01:03:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6352025-01-09T01:03:47.022ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6362025-01-09T01:03:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6372025-01-09T01:03:47.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6382025-01-09T01:03:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6392025-01-09T01:03:47.036ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6402025-01-09T01:03:47.037ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6412025-01-09T01:03:47.037ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 137.224266ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6422025-01-09T01:03:47.039ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6432025-01-09T01:03:47.039ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6442025-01-09T01:03:47.039ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 139.415155ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6452025-01-09T01:03:47.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6462025-01-09T01:03:47.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6472025-01-09T01:03:47.045ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6482025-01-09T01:03:47.045ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6492025-01-09T01:03:47.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6502025-01-09T01:03:47.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6512025-01-09T01:03:47.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6522025-01-09T01:03:47.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6532025-01-09T01:03:47.055ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6542025-01-09T01:03:47.055ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.737757ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6552025-01-09T01:03:47.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 156.686135ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6562025-01-09T01:03:47.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572025-01-09T01:03:47.060ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6582025-01-09T01:03:47.060ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 160.822408ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6592025-01-09T01:03:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6602025-01-09T01:03:47.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6612025-01-09T01:03:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6622025-01-09T01:03:47.072ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6632025-01-09T01:03:47.072ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 174.215741ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6642025-01-09T01:03:47.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 174.072167ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6652025-01-09T01:03:47.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 174.109858ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6662025-01-09T01:03:47.075ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6672025-01-09T01:03:47.075ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6682025-01-09T01:03:47.075ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6692025-01-09T01:03:47.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6702025-01-09T01:03:47.076ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "df803a5e-e486-44cf-9165-3f0f557d9f09", "content-length": "1", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6712025-01-09T01:03:47.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fe2db72-c8ef-46a1-a444-c41d53981114", "content-length": "476", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6722025-01-09T01:03:47.077ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6732025-01-09T01:03:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6742025-01-09T01:03:47.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6752025-01-09T01:03:47.078ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "db48d9af-eac6-48fa-9431-950cd14f08c8", "content-length": "734", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6762025-01-09T01:03:47.081ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6772025-01-09T01:03:47.081ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.953278ms iteration = 1 status = {}
6782025-01-09T01:03:47.081ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3969107c-219d-47e0-86f0-1252c8b89bc4", "content-length": "111", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6792025-01-09T01:03:47.082ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6802025-01-09T01:03:47.082ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c87aee69-26a6-416b-816f-890f1e56384e", "content-length": "111", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6812025-01-09T01:03:47.082ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6822025-01-09T01:03:47.083ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "811b20f7-e6f4-4a1f-a534-7a8ed9278bd6", "content-length": "167", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6832025-01-09T01:03:47.083ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6842025-01-09T01:03:47.083ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66a8ead5-4658-4274-809c-57645dde0c3d", "content-length": "167", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6852025-01-09T01:03:47.083ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6862025-01-09T01:03:47.084ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "564e4b3d-acd7-4730-b453-61ce019b07e3", "content-length": "175", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6872025-01-09T01:03:47.084ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6882025-01-09T01:03:47.084ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ae65e2-ee6e-4902-93a8-4645ace21fa0", "content-length": "175", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6892025-01-09T01:03:47.084ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6902025-01-09T01:03:47.084ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e7510dd-ff14-4a54-bc6a-33fa95233cec", "content-length": "702", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6912025-01-09T01:03:47.084ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6922025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbfc732e-3ed1-4453-865d-3ed56231063e", "content-length": "727", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6932025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6942025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d7b52ae-220b-4826-bd00-fe64b6057ae4", "content-length": "729", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6952025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6962025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "977cda37-0c90-4827-9d79-432a0ae35e91", "content-length": "728", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6972025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6982025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "00d08779-f83d-4d8d-9cb7-b64a6544562b", "content-length": "722", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
6992025-01-09T01:03:47.085ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7002025-01-09T01:03:47.086ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "24ca5aad-f13a-4920-8cbd-52d4af579781", "content-length": "109", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7012025-01-09T01:03:47.086ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7022025-01-09T01:03:47.086ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "00f899c1-cf19-40da-a1bf-f20a833eceed", "content-length": "109", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7032025-01-09T01:03:47.086ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7042025-01-09T01:03:47.086ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c27f95f-40d6-4de4-8df2-ac24bf5137ff", "content-length": "169", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7052025-01-09T01:03:47.086ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7062025-01-09T01:03:47.087ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d5d4d1d-a71e-46f4-902e-f01232d10edc", "content-length": "169", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7072025-01-09T01:03:47.087ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7082025-01-09T01:03:47.087ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4168819c-f68f-48bf-a4d1-fdeab4b7cf18", "content-length": "178", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7092025-01-09T01:03:47.087ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7102025-01-09T01:03:47.087ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc5db562-10c0-4180-9e83-2c5313df6deb", "content-length": "178", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7112025-01-09T01:03:47.087ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7122025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e78ca6-f550-44a9-b3b8-3a78e7028699", "content-length": "702", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7132025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7142025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3bce751-49ac-4bd3-ac4b-137d17cb0ac8", "content-length": "727", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7152025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7162025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9eecb9-fe57-488b-855d-0e91465d6e8a", "content-length": "729", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7172025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7182025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "be062278-b831-4bea-bbc7-edd10eab440d", "content-length": "728", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
7192025-01-09T01:03:47.088ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7202025-01-09T01:03:47.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7212025-01-09T01:03:47.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.990686ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7222025-01-09T01:03:47.091ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7232025-01-09T01:03:47.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7242025-01-09T01:03:47.093ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7252025-01-09T01:03:47.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7262025-01-09T01:03:47.096ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.150001ms iteration = 1 status = null
7272025-01-09T01:03:47.107ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
7282025-01-09T01:03:47.107ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 208.791791ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
7292025-01-09T01:03:47.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7302025-01-09T01:03:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7312025-01-09T01:03:47.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322025-01-09T01:03:47.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332025-01-09T01:03:47.117ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7342025-01-09T01:03:47.117ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7352025-01-09T01:03:47.117ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 217.311273ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7362025-01-09T01:03:47.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372025-01-09T01:03:47.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7382025-01-09T01:03:47.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7392025-01-09T01:03:47.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7402025-01-09T01:03:47.130ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412025-01-09T01:03:47.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7422025-01-09T01:03:47.132ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7432025-01-09T01:03:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7442025-01-09T01:03:47.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7452025-01-09T01:03:47.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7462025-01-09T01:03:47.156ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7472025-01-09T01:03:47.156ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7482025-01-09T01:03:47.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492025-01-09T01:03:47.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502025-01-09T01:03:47.162ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dc4b293-e9bf-4483-bfd5-655a158f51c2", "content-length": "312", "date": "Thu, 09 Jan 2025 01:03:47 GMT"} })
7512025-01-09T01:03:47.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7522025-01-09T01:03:47.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7532025-01-09T01:03:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7542025-01-09T01:03:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552025-01-09T01:03:47.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562025-01-09T01:03:47.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572025-01-09T01:03:47.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582025-01-09T01:03:47.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592025-01-09T01:03:47.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7602025-01-09T01:03:47.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612025-01-09T01:03:47.193ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7622025-01-09T01:03:47.193ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 294.135727ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7632025-01-09T01:03:47.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642025-01-09T01:03:47.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652025-01-09T01:03:47.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662025-01-09T01:03:47.241ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
7672025-01-09T01:03:47.241ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
7682025-01-09T01:03:47.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7692025-01-09T01:03:47.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702025-01-09T01:03:47.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712025-01-09T01:03:47.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722025-01-09T01:03:47.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732025-01-09T01:03:47.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742025-01-09T01:03:47.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752025-01-09T01:03:47.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762025-01-09T01:03:47.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772025-01-09T01:03:47.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7782025-01-09T01:03:47.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7792025-01-09T01:03:47.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802025-01-09T01:03:47.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812025-01-09T01:03:47.262ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7822025-01-09T01:03:47.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7832025-01-09T01:03:47.263ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "36fc8ca7-f87a-461b-bfc3-575206035696", "date": "Thu, 09 Jan 2025 01:03:47 GMT"} })
7842025-01-09T01:03:47.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7852025-01-09T01:03:47.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7862025-01-09T01:03:47.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7872025-01-09T01:03:47.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7882025-01-09T01:03:47.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892025-01-09T01:03:47.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7902025-01-09T01:03:47.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7912025-01-09T01:03:47.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7922025-01-09T01:03:47.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7932025-01-09T01:03:47.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7942025-01-09T01:03:47.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7952025-01-09T01:03:47.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7962025-01-09T01:03:47.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972025-01-09T01:03:47.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982025-01-09T01:03:47.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7992025-01-09T01:03:47.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8002025-01-09T01:03:47.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012025-01-09T01:03:47.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8022025-01-09T01:03:47.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8032025-01-09T01:03:47.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8042025-01-09T01:03:47.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8052025-01-09T01:03:47.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8062025-01-09T01:03:47.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072025-01-09T01:03:47.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082025-01-09T01:03:47.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8092025-01-09T01:03:47.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8102025-01-09T01:03:47.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8112025-01-09T01:03:47.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8122025-01-09T01:03:47.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8132025-01-09T01:03:47.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8142025-01-09T01:03:47.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8152025-01-09T01:03:47.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8162025-01-09T01:03:47.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8172025-01-09T01:03:47.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8182025-01-09T01:03:47.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8192025-01-09T01:03:47.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8202025-01-09T01:03:47.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8212025-01-09T01:03:47.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8222025-01-09T01:03:47.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8232025-01-09T01:03:47.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8242025-01-09T01:03:47.294ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8252025-01-09T01:03:47.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8262025-01-09T01:03:47.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272025-01-09T01:03:47.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8282025-01-09T01:03:47.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8292025-01-09T01:03:47.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8302025-01-09T01:03:47.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8312025-01-09T01:03:47.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8322025-01-09T01:03:47.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8332025-01-09T01:03:47.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8342025-01-09T01:03:47.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8352025-01-09T01:03:47.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8362025-01-09T01:03:47.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8372025-01-09T01:03:47.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8382025-01-09T01:03:47.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8392025-01-09T01:03:47.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8402025-01-09T01:03:47.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8412025-01-09T01:03:47.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8422025-01-09T01:03:47.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8432025-01-09T01:03:47.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8442025-01-09T01:03:47.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8452025-01-09T01:03:47.304ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8462025-01-09T01:03:47.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8472025-01-09T01:03:47.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8482025-01-09T01:03:47.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8492025-01-09T01:03:47.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8502025-01-09T01:03:47.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8512025-01-09T01:03:47.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8522025-01-09T01:03:47.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8532025-01-09T01:03:47.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8542025-01-09T01:03:47.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8552025-01-09T01:03:47.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8562025-01-09T01:03:47.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8572025-01-09T01:03:47.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8582025-01-09T01:03:47.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8592025-01-09T01:03:47.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8602025-01-09T01:03:47.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8612025-01-09T01:03:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8622025-01-09T01:03:47.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8632025-01-09T01:03:47.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8642025-01-09T01:03:47.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8652025-01-09T01:03:47.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8662025-01-09T01:03:47.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8672025-01-09T01:03:47.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8682025-01-09T01:03:47.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8692025-01-09T01:03:47.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8702025-01-09T01:03:47.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8712025-01-09T01:03:47.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8722025-01-09T01:03:47.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8732025-01-09T01:03:47.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8742025-01-09T01:03:47.318ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8752025-01-09T01:03:47.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8762025-01-09T01:03:47.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8772025-01-09T01:03:47.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8782025-01-09T01:03:47.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8792025-01-09T01:03:47.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802025-01-09T01:03:47.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8812025-01-09T01:03:47.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8822025-01-09T01:03:47.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8832025-01-09T01:03:47.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8842025-01-09T01:03:47.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8852025-01-09T01:03:47.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8862025-01-09T01:03:47.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8872025-01-09T01:03:47.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8882025-01-09T01:03:47.323ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8892025-01-09T01:03:47.323ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8902025-01-09T01:03:47.323ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8912025-01-09T01:03:47.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
8922025-01-09T01:03:47.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8932025-01-09T01:03:47.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8942025-01-09T01:03:47.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8952025-01-09T01:03:47.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8962025-01-09T01:03:47.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8972025-01-09T01:03:47.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8982025-01-09T01:03:47.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8992025-01-09T01:03:47.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9002025-01-09T01:03:47.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1e29cb31-ec12-4026-8fa9-31b3bf90200a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
9012025-01-09T01:03:47.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1e29cb31-ec12-4026-8fa9-31b3bf90200a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
9022025-01-09T01:03:47.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9032025-01-09T01:03:47.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9042025-01-09T01:03:47.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9052025-01-09T01:03:47.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9062025-01-09T01:03:47.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1e29cb31-ec12-4026-8fa9-31b3bf90200a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
9072025-01-09T01:03:47.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9082025-01-09T01:03:47.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9092025-01-09T01:03:47.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9102025-01-09T01:03:47.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9112025-01-09T01:03:47.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9122025-01-09T01:03:47.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9132025-01-09T01:03:47.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9142025-01-09T01:03:47.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9152025-01-09T01:03:47.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9162025-01-09T01:03:47.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9172025-01-09T01:03:47.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9182025-01-09T01:03:47.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9192025-01-09T01:03:47.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9202025-01-09T01:03:47.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9212025-01-09T01:03:47.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9222025-01-09T01:03:47.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9232025-01-09T01:03:47.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9242025-01-09T01:03:47.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9252025-01-09T01:03:47.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9262025-01-09T01:03:47.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9272025-01-09T01:03:47.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9282025-01-09T01:03:47.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9292025-01-09T01:03:47.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9302025-01-09T01:03:47.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9312025-01-09T01:03:47.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9322025-01-09T01:03:47.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9332025-01-09T01:03:47.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9342025-01-09T01:03:47.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9352025-01-09T01:03:47.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9362025-01-09T01:03:47.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9372025-01-09T01:03:47.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9382025-01-09T01:03:47.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9392025-01-09T01:03:47.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9402025-01-09T01:03:47.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9412025-01-09T01:03:47.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9422025-01-09T01:03:47.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
9432025-01-09T01:03:47.379ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9442025-01-09T01:03:47.380ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "40bd860f-ef3f-4ab5-9f68-c4237b72ae3d", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
9452025-01-09T01:03:47.381ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.8171ms iteration = 1 status = {}
9462025-01-09T01:03:47.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9472025-01-09T01:03:47.431ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7d3a103-c803-493f-964c-d6b3d021b00c", "content-length": "691", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
9482025-01-09T01:03:47.431ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9492025-01-09T01:03:47.431ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9502025-01-09T01:03:47.431ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9512025-01-09T01:03:47.432ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.881452ms iteration = 1 status = {}
9522025-01-09T01:03:47.441ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
9532025-01-09T01:03:47.441ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
9542025-01-09T01:03:47.441ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
9552025-01-09T01:03:47.441ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 540.926454ms
9562025-01-09T01:03:47.441ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 542.204923ms iteration = 1 status = {}
9572025-01-09T01:03:47.668ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0d3991-a531-43e2-ae1a-61542b2618cb", "content-length": "30787", "date": "Thu, 09 Jan 2025 01:03:46 GMT"} })
9582025-01-09T01:03:47.670ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9592025-01-09T01:03:47.670ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9602025-01-09T01:03:47.670ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9612025-01-09T01:03:47.672ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9622025-01-09T01:03:47.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9632025-01-09T01:03:47.674ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642025-01-09T01:03:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9652025-01-09T01:03:47.676ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9662025-01-09T01:03:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9672025-01-09T01:03:48.346ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = a4ece29b-1987-401d-9e03-78c91a55a3be file = nexus/db-queries/src/db/datastore/inventory.rs:1010
9682025-01-09T01:03:48.346ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = a4ece29b-1987-401d-9e03-78c91a55a3be time_started = 2025-01-09 01:03:47.072879 UTC
9692025-01-09T01:03:48.346ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.448571883s iteration = 1 status = {"collection_id":"a4ece29b-1987-401d-9e03-78c91a55a3be","time_done":"2025-01-09 01:03:47.670461 UTC","time_started":"2025-01-09 01:03:47.072879 UTC"}
9702025-01-09T01:03:48.346ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Timeout
9712025-01-09T01:03:48.346ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9722025-01-09T01:03:48.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9732025-01-09T01:03:48.347ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
9742025-01-09T01:03:48.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9752025-01-09T01:03:48.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9762025-01-09T01:03:48.348ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9772025-01-09T01:03:48.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782025-01-09T01:03:48.350ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9792025-01-09T01:03:48.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9802025-01-09T01:03:48.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9812025-01-09T01:03:48.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9822025-01-09T01:03:48.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9832025-01-09T01:03:48.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9842025-01-09T01:03:48.353ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
9852025-01-09T01:03:48.353ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.070367ms iteration = 2 status = {"error":"rack not yet initialized: 122d04f2-96f1-44ac-9122-b16b480179a5"}
9862025-01-09T01:03:48.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 233c9343-065c-4772-8bcf-b9fc46cd8982 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
9872025-01-09T01:03:48.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 233c9343-065c-4772-8bcf-b9fc46cd8982 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
9882025-01-09T01:03:48.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 233c9343-065c-4772-8bcf-b9fc46cd8982 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
9892025-01-09T01:03:48.381ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(bded356a-f531-4e5f-9928-c672595d8ae9, 0), (d2bf0479-8965-4213-897a-19764db0a3f8, 0), (a4ece29b-1987-401d-9e03-78c91a55a3be, 0)]
9902025-01-09T01:03:48.382ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1071, tv_nsec: 843481770 } })
9912025-01-09T01:03:48.412ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
9922025-01-09T01:03:48.412ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
9932025-01-09T01:03:48.412ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
9942025-01-09T01:03:48.413ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a17f75f-4d86-4dc9-947d-413867c5166b", "content-length": "476", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
9952025-01-09T01:03:48.413ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
9962025-01-09T01:03:48.413ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7813549-2457-40b7-b91d-f1a7239fd015", "content-length": "734", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
9972025-01-09T01:03:48.413ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
9982025-01-09T01:03:48.413ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e56b2edd-7795-4dbd-b5a6-920c7cda803d", "content-length": "111", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
9992025-01-09T01:03:48.413ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
10002025-01-09T01:03:48.414ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4109671c-cb7c-437c-9c4b-5c5fa1e4af6d", "content-length": "111", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10012025-01-09T01:03:48.414ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
10022025-01-09T01:03:48.414ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ce3edb-488d-46ae-ac3c-811cafc8ba25", "content-length": "167", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10032025-01-09T01:03:48.414ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
10042025-01-09T01:03:48.414ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4930b77c-8236-40cb-a679-d1cd29082ea8", "content-length": "167", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10052025-01-09T01:03:48.414ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
10062025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "61441107-8574-4c50-9bbc-6c8cd9d7493e", "content-length": "175", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10072025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
10082025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "547fb7a8-6597-464b-98fe-2915fba0e68f", "content-length": "175", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10092025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
10102025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "17c45ea0-e5c5-4224-80c2-4b01680cc657", "content-length": "702", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10112025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10122025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "485dca77-11bc-43bf-b0f3-9e72cef03315", "content-length": "727", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10132025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10142025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1097976-04a7-4ebc-8c8b-c33ecbe4ff57", "content-length": "729", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10152025-01-09T01:03:48.415ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10162025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ef9c142-6a82-4e69-974e-ae12f25f9612", "content-length": "728", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10172025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
10182025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6846c6b2-2dc8-4669-9a09-ec3173de1468", "content-length": "722", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10192025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
10202025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c24369-62d2-4a26-9606-ebba95ec5d35", "content-length": "109", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10212025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
10222025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eb1b689-1cfc-4ac6-b290-e0647986beef", "content-length": "109", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10232025-01-09T01:03:48.416ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
10242025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f4e956-00c3-4165-af15-e63001ff3d65", "content-length": "169", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10252025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
10262025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e501b10e-9505-4ca9-a79e-65168853dfc5", "content-length": "169", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10272025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
10282025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60ebe02c-81ca-4d50-894f-3f0d3a2c9324", "content-length": "178", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10292025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
10302025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6e873b2-bb74-42a7-9786-8e22fa9392d7", "content-length": "178", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10312025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
10322025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c8882ee-90ed-4495-8903-5e6df5a27a66", "content-length": "702", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10332025-01-09T01:03:48.417ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10342025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1576896-4b95-4e40-a26c-63d7a7ad2164", "content-length": "727", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10352025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10362025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "15588573-60e2-4ec3-a2f7-8e95f8c3bcf7", "content-length": "729", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10372025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10382025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "419caa38-8dac-4368-bfd0-129622ac22e5", "content-length": "728", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10392025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10402025-01-09T01:03:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10412025-01-09T01:03:48.420ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422025-01-09T01:03:48.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10432025-01-09T01:03:48.421ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10442025-01-09T01:03:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10452025-01-09T01:03:48.423ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462025-01-09T01:03:48.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10472025-01-09T01:03:48.425ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10482025-01-09T01:03:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10492025-01-09T01:03:48.706ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
10502025-01-09T01:03:48.706ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
10512025-01-09T01:03:48.935ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a11b18-b280-412b-8f09-c5c1d24f207e", "content-length": "30788", "date": "Thu, 09 Jan 2025 01:03:48 GMT"} })
10522025-01-09T01:03:48.937ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10532025-01-09T01:03:48.937ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10542025-01-09T01:03:48.937ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10552025-01-09T01:03:48.938ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10562025-01-09T01:03:48.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10572025-01-09T01:03:48.940ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582025-01-09T01:03:48.942ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10592025-01-09T01:03:48.942ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10602025-01-09T01:03:48.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10612025-01-09T01:03:48.981ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 84428d33-17e2-40a7-95fe-34a7c917e0b4 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
10622025-01-09T01:03:48.981ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 84428d33-17e2-40a7-95fe-34a7c917e0b4 time_started = 2025-01-09 01:03:48.412670 UTC
10632025-01-09T01:03:48.981ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 635.035168ms iteration = 2 status = {"collection_id":"84428d33-17e2-40a7-95fe-34a7c917e0b4","time_done":"2025-01-09 01:03:48.937048 UTC","time_started":"2025-01-09 01:03:48.412670 UTC"}
10642025-01-09T01:03:48.981ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
10652025-01-09T01:03:48.981ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10662025-01-09T01:03:48.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10672025-01-09T01:03:48.983ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10682025-01-09T01:03:48.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10692025-01-09T01:03:48.985ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10702025-01-09T01:03:48.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10712025-01-09T01:03:48.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10722025-01-09T01:03:48.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10732025-01-09T01:03:48.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10742025-01-09T01:03:48.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10752025-01-09T01:03:48.991ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10762025-01-09T01:03:48.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10772025-01-09T01:03:48.993ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10782025-01-09T01:03:48.994ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10792025-01-09T01:03:48.995ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10802025-01-09T01:03:48.995ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10812025-01-09T01:03:48.996ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822025-01-09T01:03:48.999ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 122d04f2-96f1-44ac-9122-b16b480179a5, lookup_type: ById(122d04f2-96f1-44ac-9122-b16b480179a5) } result = Ok(())
10832025-01-09T01:03:48.999ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
10842025-01-09T01:03:48.999ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10852025-01-09T01:03:48.999ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10862025-01-09T01:03:49.000ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10872025-01-09T01:03:49.001ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10882025-01-09T01:03:49.002ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10892025-01-09T01:03:49.002ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10902025-01-09T01:03:49.008ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10912025-01-09T01:03:49.009ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10922025-01-09T01:03:49.010ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10932025-01-09T01:03:49.010ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10942025-01-09T01:03:49.014ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10952025-01-09T01:03:49.014ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10962025-01-09T01:03:49.016ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10972025-01-09T01:03:49.019ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10982025-01-09T01:03:49.019ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10992025-01-09T01:03:49.019ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11002025-01-09T01:03:49.020ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11012025-01-09T01:03:49.020ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11022025-01-09T01:03:49.022ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11032025-01-09T01:03:49.022ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11042025-01-09T01:03:49.023ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052025-01-09T01:03:49.026ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11062025-01-09T01:03:49.026ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11072025-01-09T01:03:49.026ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11082025-01-09T01:03:49.029ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11092025-01-09T01:03:49.029ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11102025-01-09T01:03:49.031ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11112025-01-09T01:03:49.031ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11122025-01-09T01:03:49.032ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11132025-01-09T01:03:49.032ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11142025-01-09T01:03:49.033ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11152025-01-09T01:03:49.033ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11162025-01-09T01:03:49.034ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11172025-01-09T01:03:49.035ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11182025-01-09T01:03:49.036ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11192025-01-09T01:03:49.036ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11202025-01-09T01:03:49.038ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212025-01-09T01:03:49.041ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11222025-01-09T01:03:49.041ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11232025-01-09T01:03:49.041ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11242025-01-09T01:03:49.042ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11252025-01-09T01:03:49.042ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11262025-01-09T01:03:49.043ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11272025-01-09T01:03:49.043ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11282025-01-09T01:03:49.045ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11292025-01-09T01:03:49.045ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11302025-01-09T01:03:49.046ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11312025-01-09T01:03:49.047ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11322025-01-09T01:03:49.048ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11332025-01-09T01:03:49.048ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11342025-01-09T01:03:49.050ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11352025-01-09T01:03:49.050ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11362025-01-09T01:03:49.051ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372025-01-09T01:03:49.055ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11382025-01-09T01:03:49.055ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11392025-01-09T01:03:49.055ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11402025-01-09T01:03:49.056ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11412025-01-09T01:03:49.056ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11422025-01-09T01:03:49.056ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.89781ms iteration = 3 status = {"physical_disks_added":0}
11432025-01-09T01:03:49.057ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11442025-01-09T01:03:49.057ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11452025-01-09T01:03:49.059ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11462025-01-09T01:03:49.062ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11472025-01-09T01:03:49.062ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11482025-01-09T01:03:49.062ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11492025-01-09T01:03:49.066ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11502025-01-09T01:03:49.067ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11512025-01-09T01:03:49.068ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11522025-01-09T01:03:49.068ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11532025-01-09T01:03:49.069ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11542025-01-09T01:03:49.069ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11552025-01-09T01:03:49.071ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11562025-01-09T01:03:49.071ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11572025-01-09T01:03:49.074ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11582025-01-09T01:03:49.074ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11592025-01-09T01:03:49.075ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11602025-01-09T01:03:49.075ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11612025-01-09T01:03:49.076ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11622025-01-09T01:03:49.077ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11632025-01-09T01:03:49.078ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11642025-01-09T01:03:49.081ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11652025-01-09T01:03:49.081ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11662025-01-09T01:03:49.082ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11672025-01-09T01:03:49.083ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11682025-01-09T01:03:49.083ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11692025-01-09T01:03:49.084ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11702025-01-09T01:03:49.084ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11712025-01-09T01:03:49.085ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722025-01-09T01:03:49.089ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11732025-01-09T01:03:49.089ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11742025-01-09T01:03:49.089ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11752025-01-09T01:03:49.094ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 32dc4ecd-b53e-48ec-96da-e27f9d50a7c1, kind: Service { id: cffb0aad-1932-4a44-891c-2739991d1934 }, name: Name("nexus-cffb0aad-1932-4a44-891c-2739991d1934"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5bb6cca4-8c89-42c7-8517-bbec55a75150, kind: Service { id: 5236fac0-d91c-403e-8658-32167d628d4d }, name: Name("nexus-5236fac0-d91c-403e-8658-32167d628d4d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7464f2e2-2881-4143-9c24-14f2de0a4d6a, kind: Service { id: bc5aeb1b-883b-4e3c-84e4-bb4b98458327 }, name: Name("nexus-bc5aeb1b-883b-4e3c-84e4-bb4b98458327"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5082dfc8-feb0-4452-a8c4-3c0037101230, kind: Service { id: 71878588-3bc5-4be9-bddb-893f09285184 }, name: Name("external-dns-71878588-3bc5-4be9-bddb-893f09285184"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 84c8b3b4-9160-4f8a-9f93-e97bdb5fa721, kind: Service { id: 870344ce-2728-444f-8d5a-e3771e15477e }, name: Name("external-dns-870344ce-2728-444f-8d5a-e3771e15477e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 234])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
11762025-01-09T01:03:49.094ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11772025-01-09T01:03:49.094ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11782025-01-09T01:03:49.095ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792025-01-09T01:03:49.097ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
11802025-01-09T01:03:49.097ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11812025-01-09T01:03:49.097ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11822025-01-09T01:03:49.099ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
11832025-01-09T01:03:49.100ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5082dfc8-feb0-4452-a8c4-3c0037101230, kind: Service { id: 71878588-3bc5-4be9-bddb-893f09285184 }, name: Name("external-dns-71878588-3bc5-4be9-bddb-893f09285184"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 84c8b3b4-9160-4f8a-9f93-e97bdb5fa721, kind: Service { id: 870344ce-2728-444f-8d5a-e3771e15477e }, name: Name("external-dns-870344ce-2728-444f-8d5a-e3771e15477e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 234])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32dc4ecd-b53e-48ec-96da-e27f9d50a7c1, kind: Service { id: cffb0aad-1932-4a44-891c-2739991d1934 }, name: Name("nexus-cffb0aad-1932-4a44-891c-2739991d1934"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5bb6cca4-8c89-42c7-8517-bbec55a75150, kind: Service { id: 5236fac0-d91c-403e-8658-32167d628d4d }, name: Name("nexus-5236fac0-d91c-403e-8658-32167d628d4d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7464f2e2-2881-4143-9c24-14f2de0a4d6a, kind: Service { id: bc5aeb1b-883b-4e3c-84e4-bb4b98458327 }, name: Name("nexus-bc5aeb1b-883b-4e3c-84e4-bb4b98458327"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
11842025-01-09T01:03:49.100ZDEBGnexus (InternalApi): resolved 2 rules for sleds
11852025-01-09T01:03:49.154ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, time_created: 2025-01-09T01:03:45.090062Z, time_modified: 2025-01-09T01:03:45.090062Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
11862025-01-09T01:03:49.154ZDEBGnexus (InternalApi): sending firewall rules to sled agents
11872025-01-09T01:03:49.154ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11882025-01-09T01:03:49.154ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11892025-01-09T01:03:49.156ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11902025-01-09T01:03:49.156ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11912025-01-09T01:03:49.157ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922025-01-09T01:03:49.160ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
11932025-01-09T01:03:49.192ZDEBGnexus (InternalApi): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
11942025-01-09T01:03:49.193ZDEBGnexus (InternalApi): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ae331275-727c-4ed7-946b-5aa7abea76e9", "date": "Thu, 09 Jan 2025 01:03:49 GMT"} })
11952025-01-09T01:03:49.193ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
11962025-01-09T01:03:49.193ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
11972025-01-09T01:03:49.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b4e19444-ced1-4edb-9ab7-f797511f95d3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
11982025-01-09T01:03:49.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b4e19444-ced1-4edb-9ab7-f797511f95d3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
11992025-01-09T01:03:49.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b4e19444-ced1-4edb-9ab7-f797511f95d3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12002025-01-09T01:03:50.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 64710d7d-6919-4756-b979-98f6cff20007 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12012025-01-09T01:03:50.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 64710d7d-6919-4756-b979-98f6cff20007 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12022025-01-09T01:03:50.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 64710d7d-6919-4756-b979-98f6cff20007 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12032025-01-09T01:03:51.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8f878e58-9f1d-40f3-9f74-14dba138604a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12042025-01-09T01:03:51.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8f878e58-9f1d-40f3-9f74-14dba138604a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12052025-01-09T01:03:51.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8f878e58-9f1d-40f3-9f74-14dba138604a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12062025-01-09T01:03:52.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8d16affd-81c5-4f05-aeb0-f28cd563b023 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12072025-01-09T01:03:52.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8d16affd-81c5-4f05-aeb0-f28cd563b023 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12082025-01-09T01:03:52.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8d16affd-81c5-4f05-aeb0-f28cd563b023 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12092025-01-09T01:03:53.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03ae23f0-eb67-481f-8af4-226f44fd251b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12102025-01-09T01:03:53.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03ae23f0-eb67-481f-8af4-226f44fd251b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12112025-01-09T01:03:53.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03ae23f0-eb67-481f-8af4-226f44fd251b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12122025-01-09T01:03:54.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 66fe05d4-7a11-42fd-9b5d-741f8357eb9c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12132025-01-09T01:03:54.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 66fe05d4-7a11-42fd-9b5d-741f8357eb9c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12142025-01-09T01:03:54.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 66fe05d4-7a11-42fd-9b5d-741f8357eb9c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12152025-01-09T01:03:55.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fdf1df48-fdf5-4fd2-a5c1-56b0de8687ab roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12162025-01-09T01:03:55.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fdf1df48-fdf5-4fd2-a5c1-56b0de8687ab resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12172025-01-09T01:03:55.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fdf1df48-fdf5-4fd2-a5c1-56b0de8687ab response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12182025-01-09T01:03:56.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c474a772-ca40-4de5-aff9-0fdff95c25ab roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12192025-01-09T01:03:56.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c474a772-ca40-4de5-aff9-0fdff95c25ab resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12202025-01-09T01:03:56.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c474a772-ca40-4de5-aff9-0fdff95c25ab response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12212025-01-09T01:03:56.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
12222025-01-09T01:03:56.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12232025-01-09T01:03:56.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
12242025-01-09T01:03:56.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12252025-01-09T01:03:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12262025-01-09T01:03:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12272025-01-09T01:03:56.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12282025-01-09T01:03:56.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12292025-01-09T01:03:56.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12302025-01-09T01:03:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12312025-01-09T01:03:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12322025-01-09T01:03:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12332025-01-09T01:03:56.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12342025-01-09T01:03:56.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
12352025-01-09T01:03:56.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12362025-01-09T01:03:56.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12372025-01-09T01:03:56.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12382025-01-09T01:03:56.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12392025-01-09T01:03:56.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.042838ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12402025-01-09T01:03:57.206ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
12412025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 307.570659ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z","time_found":"2025-01-09T01:03:57.206571979Z"}
12422025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
12432025-01-09T01:03:57.206ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
12442025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 6.25\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
12452025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
12462025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12472025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12482025-01-09T01:03:57.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12492025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12502025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12512025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12522025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12532025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12542025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12552025-01-09T01:03:57.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12562025-01-09T01:03:57.208ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12572025-01-09T01:03:57.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12582025-01-09T01:03:57.210ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12592025-01-09T01:03:57.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12602025-01-09T01:03:57.211ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612025-01-09T01:03:57.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12622025-01-09T01:03:57.212ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12632025-01-09T01:03:57.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12642025-01-09T01:03:57.213ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12652025-01-09T01:03:57.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12662025-01-09T01:03:57.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12672025-01-09T01:03:57.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12682025-01-09T01:03:57.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12692025-01-09T01:03:57.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12702025-01-09T01:03:57.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12712025-01-09T01:03:57.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12722025-01-09T01:03:57.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12732025-01-09T01:03:57.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12742025-01-09T01:03:57.219ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12752025-01-09T01:03:57.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12762025-01-09T01:03:57.252ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
12772025-01-09T01:03:57.283ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
12782025-01-09T01:03:57.314ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
12792025-01-09T01:03:57.346ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
12802025-01-09T01:03:57.378ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
12812025-01-09T01:03:57.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 91b4fb52-d0cb-4e03-a295-80d12344a38d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12822025-01-09T01:03:57.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 91b4fb52-d0cb-4e03-a295-80d12344a38d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12832025-01-09T01:03:57.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 91b4fb52-d0cb-4e03-a295-80d12344a38d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
12842025-01-09T01:03:58.537ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "458a7c06-7b12-468d-9f7e-3fd8f6084659", "content-length": "64", "date": "Thu, 09 Jan 2025 01:03:58 GMT"} })
12852025-01-09T01:03:58.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12862025-01-09T01:03:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12872025-01-09T01:03:58.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882025-01-09T01:03:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12892025-01-09T01:03:58.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12902025-01-09T01:03:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12912025-01-09T01:03:58.546ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0e313b8-236f-4dc7-b4f4-6794019e956d", "content-length": "64", "date": "Thu, 09 Jan 2025 01:03:58 GMT"} })
12922025-01-09T01:03:58.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12932025-01-09T01:03:58.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12942025-01-09T01:03:58.548ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12952025-01-09T01:03:58.549ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12962025-01-09T01:03:58.549ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12972025-01-09T01:03:58.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12982025-01-09T01:03:58.595ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34fd4b1a-d498-43d5-bf9a-edf7ec61b689", "content-length": "64", "date": "Thu, 09 Jan 2025 01:03:58 GMT"} })
12992025-01-09T01:03:58.595ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13002025-01-09T01:03:58.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13012025-01-09T01:03:58.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13022025-01-09T01:03:58.598ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13032025-01-09T01:03:58.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13042025-01-09T01:03:58.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13052025-01-09T01:03:58.606ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0988352-87a7-4d5b-b63b-76b01812ec57", "content-length": "64", "date": "Thu, 09 Jan 2025 01:03:58 GMT"} })
13062025-01-09T01:03:58.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13072025-01-09T01:03:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13082025-01-09T01:03:58.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092025-01-09T01:03:58.609ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13102025-01-09T01:03:58.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13112025-01-09T01:03:58.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13122025-01-09T01:03:58.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5199772a-cc8b-49bb-b009-0c098d0d1600 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13132025-01-09T01:03:58.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5199772a-cc8b-49bb-b009-0c098d0d1600 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13142025-01-09T01:03:58.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5199772a-cc8b-49bb-b009-0c098d0d1600 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13152025-01-09T01:03:58.654ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b252fed-0768-41d1-a1ce-e32a657f232d", "content-length": "64", "date": "Thu, 09 Jan 2025 01:03:58 GMT"} })
13162025-01-09T01:03:58.654ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13172025-01-09T01:03:58.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13182025-01-09T01:03:58.655ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13192025-01-09T01:03:58.656ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13202025-01-09T01:03:58.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13212025-01-09T01:03:58.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13222025-01-09T01:03:58.673ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.466453306s iteration = 2 status = {"nsuccess":5}
13232025-01-09T01:03:59.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03ae9e1d-6d67-4e31-ad69-f462451c421e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13242025-01-09T01:03:59.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03ae9e1d-6d67-4e31-ad69-f462451c421e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13252025-01-09T01:03:59.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03ae9e1d-6d67-4e31-ad69-f462451c421e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13262025-01-09T01:03:59.933ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:61118
13272025-01-09T01:03:59.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 2c98478c-d5e1-46af-bf29-ae0bbfa7b118 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
13282025-01-09T01:03:59.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 2c98478c-d5e1-46af-bf29-ae0bbfa7b118 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
13292025-01-09T01:03:59.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 2c98478c-d5e1-46af-bf29-ae0bbfa7b118 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
13302025-01-09T01:03:59.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 359ea3ac-06a2-42e7-a576-f0fe8862c549 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1MjM2ZmFjMC1kOTFjLTQwM2UtODY1OC0zMjE2N2Q2MjhkNGQifX0%3D
13312025-01-09T01:03:59.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 359ea3ac-06a2-42e7-a576-f0fe8862c549 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1MjM2ZmFjMC1kOTFjLTQwM2UtODY1OC0zMjE2N2Q2MjhkNGQifX0%3D
13322025-01-09T01:03:59.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 359ea3ac-06a2-42e7-a576-f0fe8862c549 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1MjM2ZmFjMC1kOTFjLTQwM2UtODY1OC0zMjE2N2Q2MjhkNGQifX0%3D
13332025-01-09T01:04:00.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d6f368d7-2b64-415f-8e69-8dd5985dc938 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13342025-01-09T01:04:00.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d6f368d7-2b64-415f-8e69-8dd5985dc938 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13352025-01-09T01:04:00.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d6f368d7-2b64-415f-8e69-8dd5985dc938 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13362025-01-09T01:04:01.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86655552-6c7a-4b21-92c3-40ebb8b3f95e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13372025-01-09T01:04:01.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86655552-6c7a-4b21-92c3-40ebb8b3f95e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13382025-01-09T01:04:01.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86655552-6c7a-4b21-92c3-40ebb8b3f95e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13392025-01-09T01:04:02.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 45da0cc0-7f72-42bd-9d99-3f0ddd014b2c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13402025-01-09T01:04:02.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 45da0cc0-7f72-42bd-9d99-3f0ddd014b2c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13412025-01-09T01:04:02.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 45da0cc0-7f72-42bd-9d99-3f0ddd014b2c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13422025-01-09T01:04:03.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bef7dfee-4c30-4fc7-b2ce-13abe6bb5098 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13432025-01-09T01:04:03.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bef7dfee-4c30-4fc7-b2ce-13abe6bb5098 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13442025-01-09T01:04:03.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bef7dfee-4c30-4fc7-b2ce-13abe6bb5098 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13452025-01-09T01:04:04.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3b0a639d-5ed0-47a2-9309-70cdb8804ac4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13462025-01-09T01:04:04.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3b0a639d-5ed0-47a2-9309-70cdb8804ac4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13472025-01-09T01:04:04.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3b0a639d-5ed0-47a2-9309-70cdb8804ac4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13482025-01-09T01:04:05.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 631b2c42-7910-4b4f-a4e2-5071b76ddf28 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13492025-01-09T01:04:05.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 631b2c42-7910-4b4f-a4e2-5071b76ddf28 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13502025-01-09T01:04:05.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 631b2c42-7910-4b4f-a4e2-5071b76ddf28 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13512025-01-09T01:04:06.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 00c496c1-9585-4d61-9c15-b6dc95fc8cfb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13522025-01-09T01:04:06.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 00c496c1-9585-4d61-9c15-b6dc95fc8cfb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13532025-01-09T01:04:06.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 00c496c1-9585-4d61-9c15-b6dc95fc8cfb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13542025-01-09T01:04:06.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
13552025-01-09T01:04:06.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
13562025-01-09T01:04:06.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13572025-01-09T01:04:06.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13582025-01-09T01:04:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13592025-01-09T01:04:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13602025-01-09T01:04:06.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13612025-01-09T01:04:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13622025-01-09T01:04:06.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13632025-01-09T01:04:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13642025-01-09T01:04:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13652025-01-09T01:04:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662025-01-09T01:04:06.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13672025-01-09T01:04:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
13682025-01-09T01:04:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13692025-01-09T01:04:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13702025-01-09T01:04:06.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13712025-01-09T01:04:06.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13722025-01-09T01:04:06.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.040728ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13732025-01-09T01:04:07.160ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
13742025-01-09T01:04:07.160ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 261.0484ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
13752025-01-09T01:04:07.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 715ef75e-35e8-48a6-bd48-11a7a5bcd2b2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13762025-01-09T01:04:07.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 715ef75e-35e8-48a6-bd48-11a7a5bcd2b2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13772025-01-09T01:04:07.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 715ef75e-35e8-48a6-bd48-11a7a5bcd2b2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13782025-01-09T01:04:08.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 89e772c2-a88e-48c2-b45d-6a43975e10ed roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13792025-01-09T01:04:08.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 89e772c2-a88e-48c2-b45d-6a43975e10ed resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13802025-01-09T01:04:08.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 89e772c2-a88e-48c2-b45d-6a43975e10ed response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13812025-01-09T01:04:09.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f6cca761-37cc-49f6-bd67-b68ddded1344 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13822025-01-09T01:04:09.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f6cca761-37cc-49f6-bd67-b68ddded1344 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13832025-01-09T01:04:09.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f6cca761-37cc-49f6-bd67-b68ddded1344 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13842025-01-09T01:04:10.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9db07c8b-0264-4c03-936c-b818363ed1c4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13852025-01-09T01:04:10.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9db07c8b-0264-4c03-936c-b818363ed1c4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13862025-01-09T01:04:10.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9db07c8b-0264-4c03-936c-b818363ed1c4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13872025-01-09T01:04:11.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 10c6f36e-1f1c-4ee6-80c3-5ddad42e213f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13882025-01-09T01:04:11.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 10c6f36e-1f1c-4ee6-80c3-5ddad42e213f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13892025-01-09T01:04:11.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 10c6f36e-1f1c-4ee6-80c3-5ddad42e213f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13902025-01-09T01:04:12.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9591551a-00b2-4fc4-a686-def962a6aa54 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13912025-01-09T01:04:12.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9591551a-00b2-4fc4-a686-def962a6aa54 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13922025-01-09T01:04:12.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9591551a-00b2-4fc4-a686-def962a6aa54 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13932025-01-09T01:04:13.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8a799cf4-e1e2-4bcc-8c9c-d59e9cc359c2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13942025-01-09T01:04:13.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8a799cf4-e1e2-4bcc-8c9c-d59e9cc359c2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13952025-01-09T01:04:13.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8a799cf4-e1e2-4bcc-8c9c-d59e9cc359c2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13962025-01-09T01:04:14.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a861194-e564-43ce-b5ba-955d5392b234 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13972025-01-09T01:04:14.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a861194-e564-43ce-b5ba-955d5392b234 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13982025-01-09T01:04:14.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a861194-e564-43ce-b5ba-955d5392b234 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
13992025-01-09T01:04:16.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 20c917c9-542f-4821-94ca-314d3e9e43e2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
14002025-01-09T01:04:16.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 20c917c9-542f-4821-94ca-314d3e9e43e2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
14012025-01-09T01:04:16.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 20c917c9-542f-4821-94ca-314d3e9e43e2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
14022025-01-09T01:04:16.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
14032025-01-09T01:04:16.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14042025-01-09T01:04:16.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
14052025-01-09T01:04:16.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14062025-01-09T01:04:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14072025-01-09T01:04:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14082025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
14092025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
14102025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14112025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
14122025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14132025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14142025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
14152025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14162025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
14172025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
14182025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
14192025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14202025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14212025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14222025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
14232025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14242025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
14252025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14262025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14272025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
14282025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14292025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
14302025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
14312025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14322025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14332025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
14342025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14352025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
14362025-01-09T01:04:16.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14372025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14382025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
14392025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14402025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14412025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14422025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14432025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14442025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14452025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14462025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14472025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14482025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14492025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14502025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14512025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14522025-01-09T01:04:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14532025-01-09T01:04:16.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 363042231 } })
14542025-01-09T01:04:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552025-01-09T01:04:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14562025-01-09T01:04:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14572025-01-09T01:04:16.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14582025-01-09T01:04:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14592025-01-09T01:04:16.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602025-01-09T01:04:16.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612025-01-09T01:04:16.908ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.87934ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14622025-01-09T01:04:16.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14632025-01-09T01:04:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14642025-01-09T01:04:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14652025-01-09T01:04:16.911ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 372650648 } })
14662025-01-09T01:04:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14672025-01-09T01:04:16.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14682025-01-09T01:04:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14692025-01-09T01:04:16.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14702025-01-09T01:04:16.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14712025-01-09T01:04:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14722025-01-09T01:04:16.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732025-01-09T01:04:16.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14752025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14762025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14772025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14782025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14792025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14802025-01-09T01:04:16.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.799839ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14812025-01-09T01:04:16.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14822025-01-09T01:04:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14832025-01-09T01:04:16.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14842025-01-09T01:04:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14852025-01-09T01:04:16.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862025-01-09T01:04:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
14872025-01-09T01:04:16.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14882025-01-09T01:04:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14892025-01-09T01:04:16.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14902025-01-09T01:04:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14912025-01-09T01:04:16.953ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
14922025-01-09T01:04:16.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.387817ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
14932025-01-09T01:04:16.953ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.314986ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
14942025-01-09T01:04:16.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.87836ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
14952025-01-09T01:04:16.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962025-01-09T01:04:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14972025-01-09T01:04:16.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14982025-01-09T01:04:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14992025-01-09T01:04:16.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 421799407 } })
15002025-01-09T01:04:16.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
15012025-01-09T01:04:16.963ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15022025-01-09T01:04:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15032025-01-09T01:04:16.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15042025-01-09T01:04:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15052025-01-09T01:04:16.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15062025-01-09T01:04:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15072025-01-09T01:04:16.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15082025-01-09T01:04:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15092025-01-09T01:04:16.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15102025-01-09T01:04:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15112025-01-09T01:04:16.968ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15122025-01-09T01:04:16.968ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15132025-01-09T01:04:16.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15142025-01-09T01:04:16.968ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152025-01-09T01:04:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15162025-01-09T01:04:16.970ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15172025-01-09T01:04:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15182025-01-09T01:04:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15192025-01-09T01:04:16.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15202025-01-09T01:04:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15212025-01-09T01:04:16.971ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15222025-01-09T01:04:16.971ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.812353ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15232025-01-09T01:04:16.975ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15242025-01-09T01:04:16.975ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15252025-01-09T01:04:16.975ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15262025-01-09T01:04:16.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15272025-01-09T01:04:16.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15282025-01-09T01:04:16.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15292025-01-09T01:04:16.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15302025-01-09T01:04:16.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15312025-01-09T01:04:16.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15322025-01-09T01:04:16.981ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15332025-01-09T01:04:16.981ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15342025-01-09T01:04:16.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15352025-01-09T01:04:16.982ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.996793ms iteration = 4 status = {"physical_disks_added":0}
15362025-01-09T01:04:16.982ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a3a2cb-113f-4162-a8e1-198634b61027", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
15372025-01-09T01:04:16.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15382025-01-09T01:04:16.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15392025-01-09T01:04:16.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402025-01-09T01:04:16.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15412025-01-09T01:04:16.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15422025-01-09T01:04:16.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15432025-01-09T01:04:16.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15442025-01-09T01:04:16.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15452025-01-09T01:04:16.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462025-01-09T01:04:16.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15472025-01-09T01:04:16.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15482025-01-09T01:04:16.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15492025-01-09T01:04:16.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15502025-01-09T01:04:16.995ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15512025-01-09T01:04:16.995ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c55f08c4-d1cd-4cca-b3d1-63e87880d7d6", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
15522025-01-09T01:04:16.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15532025-01-09T01:04:16.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15542025-01-09T01:04:17.013ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15552025-01-09T01:04:17.013ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15562025-01-09T01:04:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.93726ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15572025-01-09T01:04:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.701788ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15582025-01-09T01:04:17.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.271853ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15592025-01-09T01:04:17.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15602025-01-09T01:04:17.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
15612025-01-09T01:04:17.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15622025-01-09T01:04:17.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15632025-01-09T01:04:17.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15642025-01-09T01:04:17.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15652025-01-09T01:04:17.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.604835ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15662025-01-09T01:04:17.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d4005f2-fce9-4581-9512-d93902e61dfa roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
15672025-01-09T01:04:17.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d4005f2-fce9-4581-9512-d93902e61dfa resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
15682025-01-09T01:04:17.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d4005f2-fce9-4581-9512-d93902e61dfa response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
15692025-01-09T01:04:17.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15702025-01-09T01:04:17.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15712025-01-09T01:04:17.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15722025-01-09T01:04:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15732025-01-09T01:04:17.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15742025-01-09T01:04:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15752025-01-09T01:04:17.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
15762025-01-09T01:04:17.078ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15772025-01-09T01:04:17.078ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c5d0a58-cad5-40e0-be3b-fedd2167141d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
15782025-01-09T01:04:17.078ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15792025-01-09T01:04:17.079ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
15802025-01-09T01:04:17.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 543912702 } })
15812025-01-09T01:04:17.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
15822025-01-09T01:04:17.105ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.598414ms iteration = 2 status = {}
15832025-01-09T01:04:17.232ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15842025-01-09T01:04:17.235ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15852025-01-09T01:04:17.235ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "96c1b6bb-86b0-4ba2-94f3-bb4aae491ae1", "content-length": "1", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
15862025-01-09T01:04:17.236ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15872025-01-09T01:04:17.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15882025-01-09T01:04:17.257ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15892025-01-09T01:04:17.257ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15902025-01-09T01:04:17.259ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 361.543697ms iteration = 2 status = null
15912025-01-09T01:04:17.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15922025-01-09T01:04:17.296ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15932025-01-09T01:04:17.296ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47f584ce-816a-4c5b-9551-91e40dbfe12f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
15942025-01-09T01:04:17.296ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15952025-01-09T01:04:17.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15962025-01-09T01:04:17.361ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
15972025-01-09T01:04:17.361ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e1c43e2-b251-42ec-96cf-adf3647e94b2", "content-length": "4", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
15982025-01-09T01:04:17.363ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 464.277415ms iteration = 2 status = 4
15992025-01-09T01:04:17.377ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac129bd9-a430-4295-9d8a-8d6af8c930a2", "content-length": "372", "date": "Thu, 09 Jan 2025 01:04:17 GMT"} })
16002025-01-09T01:04:17.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16012025-01-09T01:04:17.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c3f9cac-3a0e-4398-be98-e909997abb99", "content-length": "691", "date": "Thu, 09 Jan 2025 01:04:17 GMT"} })
16022025-01-09T01:04:17.378ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16032025-01-09T01:04:17.378ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16042025-01-09T01:04:17.378ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16052025-01-09T01:04:17.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16062025-01-09T01:04:17.379ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 480.576122ms iteration = 2 status = {}
16072025-01-09T01:04:17.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16082025-01-09T01:04:17.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16092025-01-09T01:04:17.394ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
16102025-01-09T01:04:17.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16112025-01-09T01:04:17.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16122025-01-09T01:04:17.419ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16132025-01-09T01:04:17.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7254f723-bef2-474d-84cb-fa270ff92879", "content-length": "134", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
16142025-01-09T01:04:17.428ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16152025-01-09T01:04:17.428ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
16162025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16172025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16182025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16192025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16202025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16212025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16222025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16232025-01-09T01:04:17.434ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16242025-01-09T01:04:17.435ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
16252025-01-09T01:04:17.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16262025-01-09T01:04:17.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16272025-01-09T01:04:17.437ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16282025-01-09T01:04:17.437ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16292025-01-09T01:04:17.439ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16302025-01-09T01:04:17.439ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2706b4a-7963-425c-9b4f-67ae67df8578", "content-length": "2", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
16312025-01-09T01:04:17.439ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16322025-01-09T01:04:17.439ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "67f792d9-b57f-4891-90f0-300051336975", "content-length": "52", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
16332025-01-09T01:04:17.442ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d6104a79-a917-47aa-af04-b3f7584dd67b", "date": "Thu, 09 Jan 2025 01:04:16 GMT"} })
16342025-01-09T01:04:17.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16352025-01-09T01:04:17.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16362025-01-09T01:04:17.444ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
16372025-01-09T01:04:17.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16382025-01-09T01:04:17.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16392025-01-09T01:04:17.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16402025-01-09T01:04:17.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16412025-01-09T01:04:17.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16422025-01-09T01:04:17.457ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16432025-01-09T01:04:17.457ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16442025-01-09T01:04:17.460ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aa897c34-2a45-4252-ac91-3568ef3b9414", "date": "Thu, 09 Jan 2025 01:04:17 GMT"} })
16452025-01-09T01:04:17.462ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 563.204877ms iteration = 2 status = {}
16462025-01-09T01:04:17.614ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dfdc5c52-5d12-4ee0-9763-e84c5b0b80c2", "date": "Thu, 09 Jan 2025 01:04:17 GMT"} })
16472025-01-09T01:04:17.614ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
16482025-01-09T01:04:17.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16492025-01-09T01:04:17.615ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "42745c16-1b71-489c-bc02-c84a6e63ac4d", "content-length": "682", "date": "Thu, 09 Jan 2025 01:04:17 GMT"} })
16502025-01-09T01:04:17.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16512025-01-09T01:04:17.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16522025-01-09T01:04:17.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16532025-01-09T01:04:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16542025-01-09T01:04:17.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16552025-01-09T01:04:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16562025-01-09T01:04:17.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16572025-01-09T01:04:17.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16582025-01-09T01:04:17.687ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 788.275355ms iteration = 2 status = {}
16592025-01-09T01:04:18.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff258e59-4237-4cc0-8299-bcff2e76b6e4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16602025-01-09T01:04:18.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff258e59-4237-4cc0-8299-bcff2e76b6e4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16612025-01-09T01:04:18.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff258e59-4237-4cc0-8299-bcff2e76b6e4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16622025-01-09T01:04:19.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8cd9673e-dfaa-4358-8880-659167d11e2d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16632025-01-09T01:04:19.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8cd9673e-dfaa-4358-8880-659167d11e2d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16642025-01-09T01:04:19.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8cd9673e-dfaa-4358-8880-659167d11e2d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16652025-01-09T01:04:20.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b1a02771-2c22-4114-8f24-bbb3e151c070 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16662025-01-09T01:04:20.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b1a02771-2c22-4114-8f24-bbb3e151c070 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16672025-01-09T01:04:20.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b1a02771-2c22-4114-8f24-bbb3e151c070 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16682025-01-09T01:04:21.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a483c5f2-2b13-4373-896b-8bd56285c974 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16692025-01-09T01:04:21.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a483c5f2-2b13-4373-896b-8bd56285c974 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16702025-01-09T01:04:21.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a483c5f2-2b13-4373-896b-8bd56285c974 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16712025-01-09T01:04:22.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ad6f2b8c-a7ac-4958-88ce-7e744668e025 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16722025-01-09T01:04:22.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ad6f2b8c-a7ac-4958-88ce-7e744668e025 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16732025-01-09T01:04:22.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ad6f2b8c-a7ac-4958-88ce-7e744668e025 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16742025-01-09T01:04:23.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = caec1ff3-d78d-4aba-9c3a-a75ea360066c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16752025-01-09T01:04:23.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = caec1ff3-d78d-4aba-9c3a-a75ea360066c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16762025-01-09T01:04:23.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = caec1ff3-d78d-4aba-9c3a-a75ea360066c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16772025-01-09T01:04:24.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4c6284a-8d00-4198-a262-f5eefc8b393a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16782025-01-09T01:04:24.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4c6284a-8d00-4198-a262-f5eefc8b393a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16792025-01-09T01:04:24.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4c6284a-8d00-4198-a262-f5eefc8b393a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16802025-01-09T01:04:25.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b3b805c-8b8b-4732-abcb-8f0f10dd188d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16812025-01-09T01:04:25.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b3b805c-8b8b-4732-abcb-8f0f10dd188d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16822025-01-09T01:04:25.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b3b805c-8b8b-4732-abcb-8f0f10dd188d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16832025-01-09T01:04:26.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55662ba9-7698-4a59-a053-7325f06e45f6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16842025-01-09T01:04:26.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55662ba9-7698-4a59-a053-7325f06e45f6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16852025-01-09T01:04:26.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55662ba9-7698-4a59-a053-7325f06e45f6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
16862025-01-09T01:04:26.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
16872025-01-09T01:04:26.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
16882025-01-09T01:04:26.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16892025-01-09T01:04:26.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16902025-01-09T01:04:26.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16912025-01-09T01:04:26.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16922025-01-09T01:04:26.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16932025-01-09T01:04:26.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16942025-01-09T01:04:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16952025-01-09T01:04:26.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16962025-01-09T01:04:26.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16972025-01-09T01:04:26.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16982025-01-09T01:04:26.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.626894ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16992025-01-09T01:04:26.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17002025-01-09T01:04:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17012025-01-09T01:04:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17022025-01-09T01:04:26.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
17032025-01-09T01:04:26.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17042025-01-09T01:04:26.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17052025-01-09T01:04:26.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
17062025-01-09T01:04:26.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.659659ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
17072025-01-09T01:04:27.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5cdfe96e-8dda-4104-8780-a44758a2cf18 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17082025-01-09T01:04:27.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5cdfe96e-8dda-4104-8780-a44758a2cf18 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17092025-01-09T01:04:27.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5cdfe96e-8dda-4104-8780-a44758a2cf18 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17102025-01-09T01:04:28.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1a41f63c-7fc1-4dee-997b-acef15e9bd90 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17112025-01-09T01:04:28.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1a41f63c-7fc1-4dee-997b-acef15e9bd90 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17122025-01-09T01:04:28.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1a41f63c-7fc1-4dee-997b-acef15e9bd90 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17132025-01-09T01:04:29.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e5d3377-8b93-4033-a2bd-56605b9ed9ca roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17142025-01-09T01:04:29.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e5d3377-8b93-4033-a2bd-56605b9ed9ca resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17152025-01-09T01:04:29.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e5d3377-8b93-4033-a2bd-56605b9ed9ca response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17162025-01-09T01:04:30.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9d4a0c9-eb06-46cd-a8d1-5b4838770efd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17172025-01-09T01:04:30.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9d4a0c9-eb06-46cd-a8d1-5b4838770efd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17182025-01-09T01:04:30.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9d4a0c9-eb06-46cd-a8d1-5b4838770efd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17192025-01-09T01:04:31.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = efb3ba34-b309-4e08-8e0c-587e99ba7cd6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17202025-01-09T01:04:31.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = efb3ba34-b309-4e08-8e0c-587e99ba7cd6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17212025-01-09T01:04:31.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = efb3ba34-b309-4e08-8e0c-587e99ba7cd6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17222025-01-09T01:04:32.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36eca853-3146-42ed-b109-6e9ab06494eb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17232025-01-09T01:04:32.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36eca853-3146-42ed-b109-6e9ab06494eb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17242025-01-09T01:04:32.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36eca853-3146-42ed-b109-6e9ab06494eb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17252025-01-09T01:04:33.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8727c648-e31a-4499-82ca-3a4cc85f97ac roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17262025-01-09T01:04:33.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8727c648-e31a-4499-82ca-3a4cc85f97ac resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17272025-01-09T01:04:33.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8727c648-e31a-4499-82ca-3a4cc85f97ac response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17282025-01-09T01:04:34.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 861f0d2d-4ce6-4d88-862d-e68ac41863b5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17292025-01-09T01:04:34.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 861f0d2d-4ce6-4d88-862d-e68ac41863b5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17302025-01-09T01:04:34.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 861f0d2d-4ce6-4d88-862d-e68ac41863b5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17312025-01-09T01:04:35.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c176ad54-5f5f-49a9-8dbd-915ed128561f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17322025-01-09T01:04:35.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c176ad54-5f5f-49a9-8dbd-915ed128561f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17332025-01-09T01:04:35.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c176ad54-5f5f-49a9-8dbd-915ed128561f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17342025-01-09T01:04:36.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = da124f8e-a289-454b-be52-1607a72503ae roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17352025-01-09T01:04:36.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = da124f8e-a289-454b-be52-1607a72503ae resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17362025-01-09T01:04:36.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = da124f8e-a289-454b-be52-1607a72503ae response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17372025-01-09T01:04:36.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
17382025-01-09T01:04:36.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
17392025-01-09T01:04:36.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17402025-01-09T01:04:36.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17412025-01-09T01:04:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17422025-01-09T01:04:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17432025-01-09T01:04:36.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17442025-01-09T01:04:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17452025-01-09T01:04:36.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.111689ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17462025-01-09T01:04:36.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472025-01-09T01:04:36.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17482025-01-09T01:04:36.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17492025-01-09T01:04:36.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17502025-01-09T01:04:36.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17512025-01-09T01:04:36.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17522025-01-09T01:04:36.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532025-01-09T01:04:36.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
17542025-01-09T01:04:36.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17552025-01-09T01:04:36.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17562025-01-09T01:04:36.955ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
17572025-01-09T01:04:36.955ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.499712ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
17582025-01-09T01:04:37.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ae8d5b5e-bc9e-46ee-9a28-f9a27cb43a9f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17592025-01-09T01:04:37.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ae8d5b5e-bc9e-46ee-9a28-f9a27cb43a9f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17602025-01-09T01:04:37.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ae8d5b5e-bc9e-46ee-9a28-f9a27cb43a9f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17612025-01-09T01:04:38.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b29333a-8060-49c4-9158-acb5ec37a35a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17622025-01-09T01:04:38.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b29333a-8060-49c4-9158-acb5ec37a35a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17632025-01-09T01:04:38.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b29333a-8060-49c4-9158-acb5ec37a35a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17642025-01-09T01:04:39.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 70bf43c3-27fe-49e0-905b-f54a77d8f8aa roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17652025-01-09T01:04:39.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 70bf43c3-27fe-49e0-905b-f54a77d8f8aa resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17662025-01-09T01:04:39.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 70bf43c3-27fe-49e0-905b-f54a77d8f8aa response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17672025-01-09T01:04:40.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b07ce810-2436-43d6-a69c-120ab449e3e2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17682025-01-09T01:04:40.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b07ce810-2436-43d6-a69c-120ab449e3e2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17692025-01-09T01:04:40.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b07ce810-2436-43d6-a69c-120ab449e3e2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17702025-01-09T01:04:41.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 759b0054-c6bf-400c-b842-ad9e81fdc384 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17712025-01-09T01:04:41.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 759b0054-c6bf-400c-b842-ad9e81fdc384 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17722025-01-09T01:04:41.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 759b0054-c6bf-400c-b842-ad9e81fdc384 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17732025-01-09T01:04:42.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e58fbc33-248d-4541-ac9f-62860c48d0ca roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17742025-01-09T01:04:42.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e58fbc33-248d-4541-ac9f-62860c48d0ca resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17752025-01-09T01:04:42.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e58fbc33-248d-4541-ac9f-62860c48d0ca response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17762025-01-09T01:04:43.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 584f3a97-d58b-4ee1-ae65-f55415bf4700 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17772025-01-09T01:04:43.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 584f3a97-d58b-4ee1-ae65-f55415bf4700 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17782025-01-09T01:04:43.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 584f3a97-d58b-4ee1-ae65-f55415bf4700 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17792025-01-09T01:04:44.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f7f01299-dfd6-44f1-b9f6-719a4271357b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17802025-01-09T01:04:44.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f7f01299-dfd6-44f1-b9f6-719a4271357b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17812025-01-09T01:04:44.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f7f01299-dfd6-44f1-b9f6-719a4271357b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17822025-01-09T01:04:44.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = a493b470-1ae8-45ae-8198-f6278c2aa6d6 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
17832025-01-09T01:04:44.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = a493b470-1ae8-45ae-8198-f6278c2aa6d6 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
17842025-01-09T01:04:44.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = a493b470-1ae8-45ae-8198-f6278c2aa6d6 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
17852025-01-09T01:04:44.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 49e0763d-78ef-4817-9c36-3b6204146868 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2NmUwM2JjOC0wZGQyLTRmMmEtOTNjMC1jZTFjNGYyZjFlNGEifX0%3D
17862025-01-09T01:04:44.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 49e0763d-78ef-4817-9c36-3b6204146868 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2NmUwM2JjOC0wZGQyLTRmMmEtOTNjMC1jZTFjNGYyZjFlNGEifX0%3D
17872025-01-09T01:04:44.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61118 req_id = 49e0763d-78ef-4817-9c36-3b6204146868 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2NmUwM2JjOC0wZGQyLTRmMmEtOTNjMC1jZTFjNGYyZjFlNGEifX0%3D
17882025-01-09T01:04:45.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 09f608cb-337c-428c-a264-a6f720b5e82b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17892025-01-09T01:04:45.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 09f608cb-337c-428c-a264-a6f720b5e82b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17902025-01-09T01:04:45.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 09f608cb-337c-428c-a264-a6f720b5e82b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17912025-01-09T01:04:46.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 65594db6-bb8f-4da3-95ab-74e0ed121dc0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17922025-01-09T01:04:46.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 65594db6-bb8f-4da3-95ab-74e0ed121dc0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17932025-01-09T01:04:46.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 65594db6-bb8f-4da3-95ab-74e0ed121dc0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
17942025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
17952025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17962025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
17972025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17982025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
17992025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18002025-01-09T01:04:46.898ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:54:46.898318232 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18012025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18022025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
18032025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
18042025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18052025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18062025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18072025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
18082025-01-09T01:04:46.898ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18092025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
18102025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 17.38\u{b5}s iteration = 3 status = {"error":"no config"}
18112025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
18122025-01-09T01:04:46.898ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18132025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.2\u{b5}s iteration = 3 status = {"error":"no config"}
18142025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
18152025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
18162025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18172025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18182025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18192025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18202025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18212025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18222025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18232025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
18242025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
18252025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18262025-01-09T01:04:46.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18272025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
18282025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
18292025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18302025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18312025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
18322025-01-09T01:04:46.899ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18332025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
18342025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18352025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18362025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
18372025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
18382025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
18392025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18402025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18412025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
18422025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18432025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
18442025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18452025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18462025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
18472025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
18482025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18492025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
18502025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18512025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18522025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
18532025-01-09T01:04:46.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18542025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18552025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
18562025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18572025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
18582025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18592025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
18602025-01-09T01:04:46.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
18612025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.23\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
18622025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
18632025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18642025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
18652025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18662025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18672025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18682025-01-09T01:04:46.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 360442447 } })
18692025-01-09T01:04:46.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 360444737 } })
18702025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18712025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18722025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18732025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18742025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18752025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18762025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18772025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18782025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18792025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18802025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18812025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18822025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18832025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18842025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.469003ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18852025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18862025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
18872025-01-09T01:04:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.554345ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
18882025-01-09T01:04:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18892025-01-09T01:04:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18902025-01-09T01:04:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18912025-01-09T01:04:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18922025-01-09T01:04:46.901ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:54:46.898318232 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18932025-01-09T01:04:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.058518ms iteration = 2 status = {"expiration":"2025-01-09T00:54:46.898318232Z","pruned":[]}
18942025-01-09T01:04:46.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 363277481 } })
18952025-01-09T01:04:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18962025-01-09T01:04:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18972025-01-09T01:04:46.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18982025-01-09T01:04:46.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18992025-01-09T01:04:46.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 364290794 } })
19002025-01-09T01:04:46.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19012025-01-09T01:04:46.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19022025-01-09T01:04:46.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19032025-01-09T01:04:46.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19042025-01-09T01:04:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19052025-01-09T01:04:46.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-01-09T01:04:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.404944ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19072025-01-09T01:04:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19082025-01-09T01:04:46.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19092025-01-09T01:04:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19102025-01-09T01:04:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19112025-01-09T01:04:46.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19122025-01-09T01:04:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19132025-01-09T01:04:46.912ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19142025-01-09T01:04:46.912ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19152025-01-09T01:04:46.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19162025-01-09T01:04:46.912ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172025-01-09T01:04:46.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182025-01-09T01:04:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19192025-01-09T01:04:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19202025-01-09T01:04:46.915ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19212025-01-09T01:04:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19222025-01-09T01:04:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19232025-01-09T01:04:46.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19242025-01-09T01:04:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19252025-01-09T01:04:46.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19262025-01-09T01:04:46.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.029915ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
19272025-01-09T01:04:46.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282025-01-09T01:04:46.921ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.518139ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
19292025-01-09T01:04:46.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19302025-01-09T01:04:46.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19312025-01-09T01:04:46.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19322025-01-09T01:04:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19332025-01-09T01:04:46.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19342025-01-09T01:04:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19352025-01-09T01:04:46.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-01-09T01:04:46.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372025-01-09T01:04:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19382025-01-09T01:04:46.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19392025-01-09T01:04:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19402025-01-09T01:04:46.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19412025-01-09T01:04:46.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19422025-01-09T01:04:46.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19432025-01-09T01:04:46.933ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 394176308 } })
19442025-01-09T01:04:46.933ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
19452025-01-09T01:04:46.935ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19462025-01-09T01:04:46.935ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19472025-01-09T01:04:46.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19482025-01-09T01:04:46.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19492025-01-09T01:04:46.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19502025-01-09T01:04:46.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19512025-01-09T01:04:46.938ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19522025-01-09T01:04:46.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19532025-01-09T01:04:46.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542025-01-09T01:04:46.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19552025-01-09T01:04:46.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19562025-01-09T01:04:46.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19572025-01-09T01:04:46.941ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19582025-01-09T01:04:46.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19592025-01-09T01:04:46.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19602025-01-09T01:04:46.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19612025-01-09T01:04:46.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19622025-01-09T01:04:46.947ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19632025-01-09T01:04:46.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19642025-01-09T01:04:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
19652025-01-09T01:04:46.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19662025-01-09T01:04:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19672025-01-09T01:04:46.959ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19682025-01-09T01:04:46.959ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19692025-01-09T01:04:46.959ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.632848ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19702025-01-09T01:04:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.057735ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
19712025-01-09T01:04:46.966ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
19722025-01-09T01:04:46.966ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.462422ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
19732025-01-09T01:04:46.973ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19742025-01-09T01:04:46.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19752025-01-09T01:04:46.979ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19762025-01-09T01:04:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19772025-01-09T01:04:46.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19782025-01-09T01:04:46.980ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19792025-01-09T01:04:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19802025-01-09T01:04:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19812025-01-09T01:04:46.981ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19822025-01-09T01:04:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19832025-01-09T01:04:46.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19842025-01-09T01:04:46.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19852025-01-09T01:04:46.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.987317ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19862025-01-09T01:04:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19872025-01-09T01:04:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19882025-01-09T01:04:46.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19892025-01-09T01:04:46.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19902025-01-09T01:04:46.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19912025-01-09T01:04:46.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19922025-01-09T01:04:46.993ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19932025-01-09T01:04:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19942025-01-09T01:04:46.995ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19952025-01-09T01:04:46.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19962025-01-09T01:04:46.995ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19972025-01-09T01:04:46.996ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a77dcf7-d4c7-4064-972f-40a5569156fd", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} })
19982025-01-09T01:04:46.996ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19992025-01-09T01:04:46.996ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20002025-01-09T01:04:46.996ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20012025-01-09T01:04:46.997ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5b771d4-0582-4c1e-acf3-1e8bc24d2f52", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} })
20022025-01-09T01:04:46.997ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20032025-01-09T01:04:46.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20042025-01-09T01:04:46.999ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20052025-01-09T01:04:46.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
20062025-01-09T01:04:46.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20072025-01-09T01:04:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20082025-01-09T01:04:47.001ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20092025-01-09T01:04:47.001ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20102025-01-09T01:04:47.001ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.617466ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20112025-01-09T01:04:47.002ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.830442ms iteration = 3 status = 0
20122025-01-09T01:04:47.009ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20132025-01-09T01:04:47.009ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20142025-01-09T01:04:47.009ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.792759ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20152025-01-09T01:04:47.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20162025-01-09T01:04:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20172025-01-09T01:04:47.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20182025-01-09T01:04:47.014ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20192025-01-09T01:04:47.014ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.318142ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20202025-01-09T01:04:47.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20212025-01-09T01:04:47.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20222025-01-09T01:04:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20232025-01-09T01:04:47.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20242025-01-09T01:04:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20252025-01-09T01:04:47.022ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.136369ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20262025-01-09T01:04:47.025ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.206227ms iteration = 5 status = {"physical_disks_added":0}
20272025-01-09T01:04:47.028ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.441201ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20282025-01-09T01:04:47.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 132.052ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20292025-01-09T01:04:47.034ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20302025-01-09T01:04:47.034ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20312025-01-09T01:04:47.034ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20322025-01-09T01:04:47.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20332025-01-09T01:04:47.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20342025-01-09T01:04:47.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352025-01-09T01:04:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20362025-01-09T01:04:47.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20372025-01-09T01:04:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20382025-01-09T01:04:47.040ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20392025-01-09T01:04:47.040ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20402025-01-09T01:04:47.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20412025-01-09T01:04:47.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20422025-01-09T01:04:47.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20432025-01-09T01:04:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20442025-01-09T01:04:47.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20452025-01-09T01:04:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20462025-01-09T01:04:47.049ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20472025-01-09T01:04:47.049ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20482025-01-09T01:04:47.049ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
20492025-01-09T01:04:47.049ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 151.257382ms iteration = 2 status = {"generation":1}
20502025-01-09T01:04:47.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
20512025-01-09T01:04:47.057ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
20522025-01-09T01:04:47.057ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20532025-01-09T01:04:47.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20542025-01-09T01:04:47.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20552025-01-09T01:04:47.058ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d00fc024-22b0-4147-a81c-b9dbfe630151", "content-length": "26", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} })
20562025-01-09T01:04:47.058ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20572025-01-09T01:04:47.059ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
20582025-01-09T01:04:47.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20592025-01-09T01:04:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20602025-01-09T01:04:47.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20612025-01-09T01:04:47.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20622025-01-09T01:04:47.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20632025-01-09T01:04:47.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20642025-01-09T01:04:47.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20652025-01-09T01:04:47.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20662025-01-09T01:04:47.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20672025-01-09T01:04:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20682025-01-09T01:04:47.089ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20692025-01-09T01:04:47.089ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20702025-01-09T01:04:47.089ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20712025-01-09T01:04:47.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20722025-01-09T01:04:47.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20732025-01-09T01:04:47.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742025-01-09T01:04:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20752025-01-09T01:04:47.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20762025-01-09T01:04:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20772025-01-09T01:04:47.102ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20782025-01-09T01:04:47.102ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
20792025-01-09T01:04:47.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20802025-01-09T01:04:47.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20812025-01-09T01:04:47.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20822025-01-09T01:04:47.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20832025-01-09T01:04:47.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20842025-01-09T01:04:47.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20852025-01-09T01:04:47.122ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20862025-01-09T01:04:47.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 223.708267ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20872025-01-09T01:04:47.130ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20882025-01-09T01:04:47.130ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbe6a4c8-f72a-49e6-9210-efd721778a9f", "content-length": "1", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} })
20892025-01-09T01:04:47.132ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20902025-01-09T01:04:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20912025-01-09T01:04:47.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20922025-01-09T01:04:47.199ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
20932025-01-09T01:04:47.199ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 300.995711ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20942025-01-09T01:04:47.239ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.225249ms iteration = 3 status = {}
20952025-01-09T01:04:47.240ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20962025-01-09T01:04:47.240ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20972025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
20982025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
20992025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
21002025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
21012025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
21022025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
21032025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
21042025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
21052025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
21062025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
21072025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
21082025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
21092025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles versions = all
21102025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/system/support-bundles versions = all
21112025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
21122025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
21132025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
21142025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
21152025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
21162025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
21172025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
21182025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
21192025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
21202025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
21212025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21222025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21232025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21242025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
21252025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
21262025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
21272025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
21282025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
21292025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
21302025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
21312025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
21322025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
21332025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
21342025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
21352025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
21362025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
21372025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
21382025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21392025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21402025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21412025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
21422025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21432025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
21442025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
21452025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21462025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21472025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21482025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21492025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21502025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
21512025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
21522025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
21532025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
21542025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
21552025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
21562025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
21572025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
21582025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
21592025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
21602025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
21612025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
21622025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
21632025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
21642025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21652025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21662025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
21672025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21682025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21692025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
21702025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
21712025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21722025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21732025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
21742025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
21752025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21762025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21772025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21782025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
21792025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
21802025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21812025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
21822025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
21832025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
21842025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
21852025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
21862025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
21872025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
21882025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
21892025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
21902025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
21912025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
21922025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
21932025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
21942025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
21952025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
21962025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
21972025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
21982025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21992025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
22002025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
22012025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
22022025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
22032025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
22042025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
22052025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
22062025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
22072025-01-09T01:04:47.242ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
22082025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
22092025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
22102025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
22112025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
22122025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
22132025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
22142025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
22152025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
22162025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
22172025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
22182025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
22192025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
22202025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
22212025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22222025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22232025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22242025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22252025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22262025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
22272025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22282025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22292025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22302025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
22312025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22322025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
22332025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
22342025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22352025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22362025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
22372025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22382025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
22392025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
22402025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22412025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
22422025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22432025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22442025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22452025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22462025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22472025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22482025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22492025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22502025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22512025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
22522025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22532025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22542025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22552025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
22562025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
22572025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
22582025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22592025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22602025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
22612025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
22622025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
22632025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
22642025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
22652025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
22662025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
22672025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
22682025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22692025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22702025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22712025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22722025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
22732025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
22742025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22752025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
22762025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
22772025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
22782025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22792025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
22802025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
22812025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
22822025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
22832025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
22842025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
22852025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
22862025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
22872025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
22882025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
22892025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
22902025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
22912025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
22922025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
22932025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
22942025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
22952025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22962025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22972025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
22982025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
22992025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
23002025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
23012025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
23022025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
23032025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
23042025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
23052025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
23062025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
23072025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
23082025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
23092025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
23102025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
23112025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
23122025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
23132025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
23142025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
23152025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
23162025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
23172025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
23182025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
23192025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
23202025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
23212025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
23222025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
23232025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
23242025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
23252025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23262025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23272025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23282025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
23292025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
23302025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
23312025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
23322025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
23332025-01-09T01:04:47.243ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
23342025-01-09T01:04:47.243ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
23352025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
23362025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
23372025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
23382025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
23392025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
23402025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
23412025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
23422025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
23432025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
23442025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
23452025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
23462025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
23472025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
23482025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
23492025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
23502025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
23512025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
23522025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
23532025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
23542025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
23552025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
23562025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
23572025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
23582025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
23592025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
23602025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
23612025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
23622025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
23632025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
23642025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
23652025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
23662025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
23672025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
23682025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
23692025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
23702025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
23712025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
23722025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
23732025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
23742025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
23752025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
23762025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
23772025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
23782025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
23792025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
23802025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
23812025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
23822025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
23832025-01-09T01:04:47.249ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
23842025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
23852025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
23862025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
23872025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
23882025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
23892025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
23902025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
23912025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
23922025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
23932025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
23942025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
23952025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
23962025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
23972025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
23982025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
23992025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
24002025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
24012025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
24022025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
24032025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
24042025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
24052025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
24062025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
24072025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
24082025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
24092025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
24102025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
24112025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
24122025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
24132025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
24142025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
24152025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
24162025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
24172025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
24182025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
24192025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
24202025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
24212025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
24222025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
24232025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
24242025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
24252025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
24262025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
24272025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
24282025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
24292025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
24302025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
24312025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
24322025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
24332025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
24342025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
24352025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
24362025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
24372025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
24382025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
24392025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
24402025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
24412025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
24422025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
24432025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
24442025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
24452025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
24462025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
24472025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
24482025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
24492025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
24502025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
24512025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
24522025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
24532025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
24542025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
24552025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
24562025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
24572025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
24582025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
24592025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
24602025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
24612025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
24622025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
24632025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
24642025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
24652025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
24662025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
24672025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
24682025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
24692025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
24702025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
24712025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
24722025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
24732025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
24742025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
24752025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
24762025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
24772025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
24782025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
24792025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
24802025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
24812025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
24822025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
24832025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
24842025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
24852025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
24862025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24872025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24882025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
24892025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
24902025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
24912025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
24922025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
24932025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
24942025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
24952025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
24962025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
24972025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
24982025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
24992025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
25002025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
25012025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
25022025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
25032025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
25042025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
25052025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
25062025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
25072025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
25082025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
25092025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
25102025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
25112025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
25122025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
25132025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
25142025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
25152025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
25162025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
25172025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
25182025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
25192025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
25202025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
25212025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
25222025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
25232025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
25242025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
25252025-01-09T01:04:47.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
25262025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
25272025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
25282025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
25292025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
25302025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
25312025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
25322025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
25332025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
25342025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
25352025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
25362025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
25372025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
25382025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
25392025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
25402025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
25412025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
25422025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
25432025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
25442025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
25452025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
25462025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
25472025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
25482025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
25492025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
25502025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
25512025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
25522025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
25532025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
25542025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
25552025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
25562025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
25572025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
25582025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
25592025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
25602025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
25612025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
25622025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
25632025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
25642025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
25652025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
25662025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
25672025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
25682025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
25692025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
25702025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
25712025-01-09T01:04:47.251ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
25722025-01-09T01:04:47.251ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
25732025-01-09T01:04:47.256ZDEBGnexus (nexus-producer-server): registered DTrace probes
25742025-01-09T01:04:47.261ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:35467 method = GET path = /{producer_id} versions = all
25752025-01-09T01:04:47.262ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:35467
25762025-01-09T01:04:47.262ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:35467
25772025-01-09T01:04:47.262ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:35467
25782025-01-09T01:04:47.262ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
25792025-01-09T01:04:47.262ZDEBGnexus (nexus-producer-server): starting producer registration task
25802025-01-09T01:04:47.263ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:35467 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
25812025-01-09T01:04:47.263ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
25822025-01-09T01:04:47.263ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
25832025-01-09T01:04:47.277ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25842025-01-09T01:04:47.280ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
25852025-01-09T01:04:47.280ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25862025-01-09T01:04:47.280ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
25872025-01-09T01:04:47.280ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 381.682392ms iteration = 2 status = {"generation":2}
25882025-01-09T01:04:47.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
25892025-01-09T01:04:47.280ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 382.401968ms iteration = 3 status = null
25902025-01-09T01:04:47.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c92beb9-2b88-41b0-9623-b1175513dc08", "content-length": "372", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
25912025-01-09T01:04:47.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25922025-01-09T01:04:47.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7a4e851-ba4f-427d-a392-53626e377d67", "content-length": "691", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
25932025-01-09T01:04:47.285ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25942025-01-09T01:04:47.285ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25952025-01-09T01:04:47.285ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25962025-01-09T01:04:47.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25972025-01-09T01:04:47.287ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.249299ms iteration = 3 status = {}
25982025-01-09T01:04:47.302ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25992025-01-09T01:04:47.302ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26002025-01-09T01:04:47.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0e79fd71-908b-4708-b3aa-4872813b8b9d", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
26012025-01-09T01:04:47.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26022025-01-09T01:04:47.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26032025-01-09T01:04:47.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26042025-01-09T01:04:47.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26052025-01-09T01:04:47.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26062025-01-09T01:04:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26072025-01-09T01:04:47.312ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26082025-01-09T01:04:47.312ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26092025-01-09T01:04:47.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e19df96-2fd0-419e-8527-a75b27873f17", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
26102025-01-09T01:04:47.314ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.565486ms iteration = 3 status = {}
26112025-01-09T01:04:47.315ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26122025-01-09T01:04:47.370ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
26132025-01-09T01:04:47.370ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:40115
26142025-01-09T01:04:47.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40115 req_id = 74c1d180-35f0-4abd-82a0-32e65b5aedd2 roles = RoleSet { roles: {} } uri = /metrics/producers
26152025-01-09T01:04:47.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40115 req_id = 74c1d180-35f0-4abd-82a0-32e65b5aedd2 resource = Database result = Ok(()) uri = /metrics/producers
26162025-01-09T01:04:47.385ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26172025-01-09T01:04:47.418ZINFOnexus: assigned collector to new producer collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 file = nexus/src/app/oximeter.rs:76 producer_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
26182025-01-09T01:04:47.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47695 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40115 req_id = 74c1d180-35f0-4abd-82a0-32e65b5aedd2 response_code = 201 uri = /metrics/producers
26192025-01-09T01:04:47.418ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "74c1d180-35f0-4abd-82a0-32e65b5aedd2", "content-length": "41", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
26202025-01-09T01:04:47.419ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26212025-01-09T01:04:47.420ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ef58e718-8c14-4ef2-8c65-e0ca697c91e8", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26222025-01-09T01:04:47.420ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26232025-01-09T01:04:47.420ZDEBGnexus (producer-registration-task): registered with nexus successfully
26242025-01-09T01:04:47.420ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
26252025-01-09T01:04:47.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26262025-01-09T01:04:47.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26272025-01-09T01:04:47.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0fe0597f-2c98-4ccf-b1af-02c1e5ba3bec", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26282025-01-09T01:04:47.421ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26292025-01-09T01:04:47.422ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "46f296b4-ed32-4773-bf0e-003be519ada3", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26302025-01-09T01:04:47.422ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26312025-01-09T01:04:47.422ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
26322025-01-09T01:04:47.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26332025-01-09T01:04:47.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26342025-01-09T01:04:47.424ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
26352025-01-09T01:04:47.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 375.086902ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26362025-01-09T01:04:47.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26372025-01-09T01:04:47.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b29c968c-6f02-4fd1-813b-acce54236ba5", "content-length": "134", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
26382025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26392025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
26402025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26412025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26422025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26432025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26442025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26452025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26462025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26472025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26482025-01-09T01:04:47.433ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
26492025-01-09T01:04:47.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26502025-01-09T01:04:47.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26512025-01-09T01:04:47.436ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26522025-01-09T01:04:47.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "196162ff-7a21-42f9-b7cd-3453378599b5", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26532025-01-09T01:04:47.436ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26542025-01-09T01:04:47.437ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "02cfe58c-e027-4b85-84e4-abe90417d5aa", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26552025-01-09T01:04:47.437ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26562025-01-09T01:04:47.439ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26572025-01-09T01:04:47.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 159.414696ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26582025-01-09T01:04:47.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26592025-01-09T01:04:47.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "110c3274-207a-4eb5-b7e1-60b72a24a5dc", "content-length": "2", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
26602025-01-09T01:04:47.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26612025-01-09T01:04:47.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "30974aff-c30a-4124-a4e5-e3549553b320", "content-length": "52", "date": "Thu, 09 Jan 2025 01:04:47 GMT"} })
26622025-01-09T01:04:47.442ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
26632025-01-09T01:04:47.442ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26642025-01-09T01:04:47.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2b0f133-9db3-449f-80cd-07a81b7c75c1", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} })
26652025-01-09T01:04:47.535ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
26662025-01-09T01:04:47.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26672025-01-09T01:04:47.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "13465853-cdd5-4f79-8cd8-7634d8c3a680", "content-length": "682", "date": "Thu, 09 Jan 2025 01:04:46 GMT"} })
26682025-01-09T01:04:47.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26692025-01-09T01:04:47.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26702025-01-09T01:04:47.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26712025-01-09T01:04:47.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26722025-01-09T01:04:47.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26732025-01-09T01:04:47.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26742025-01-09T01:04:47.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26752025-01-09T01:04:47.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26762025-01-09T01:04:47.550ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 651.145831ms iteration = 3 status = {}
26772025-01-09T01:04:47.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a7d0e3de-6731-4ee6-b280-a422dd480e0b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26782025-01-09T01:04:47.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a7d0e3de-6731-4ee6-b280-a422dd480e0b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26792025-01-09T01:04:47.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a7d0e3de-6731-4ee6-b280-a422dd480e0b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26802025-01-09T01:04:48.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d3e7bf73-f231-49d2-a377-de2025666c02 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26812025-01-09T01:04:48.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d3e7bf73-f231-49d2-a377-de2025666c02 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26822025-01-09T01:04:48.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d3e7bf73-f231-49d2-a377-de2025666c02 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26832025-01-09T01:04:49.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c7531c7-ea39-482b-85d7-eef8c9b0dec1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26842025-01-09T01:04:49.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c7531c7-ea39-482b-85d7-eef8c9b0dec1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26852025-01-09T01:04:49.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c7531c7-ea39-482b-85d7-eef8c9b0dec1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26862025-01-09T01:04:50.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 34a37243-3cc2-4667-9e06-e4a76ec24c27 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26872025-01-09T01:04:50.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 34a37243-3cc2-4667-9e06-e4a76ec24c27 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26882025-01-09T01:04:50.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 34a37243-3cc2-4667-9e06-e4a76ec24c27 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26892025-01-09T01:04:51.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 08c63020-2191-4b38-a7f7-64199f7ae3b6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26902025-01-09T01:04:51.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 08c63020-2191-4b38-a7f7-64199f7ae3b6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26912025-01-09T01:04:51.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 08c63020-2191-4b38-a7f7-64199f7ae3b6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26922025-01-09T01:04:52.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2204149-3d24-4403-bf9a-a36914a1adb9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26932025-01-09T01:04:52.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2204149-3d24-4403-bf9a-a36914a1adb9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26942025-01-09T01:04:52.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2204149-3d24-4403-bf9a-a36914a1adb9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26952025-01-09T01:04:53.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c99962df-5c6f-4efb-a968-f017d910c9f9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26962025-01-09T01:04:53.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c99962df-5c6f-4efb-a968-f017d910c9f9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26972025-01-09T01:04:53.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c99962df-5c6f-4efb-a968-f017d910c9f9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26982025-01-09T01:04:54.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ec1bd616-8b00-4542-9413-03b5b8f1431a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
26992025-01-09T01:04:54.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ec1bd616-8b00-4542-9413-03b5b8f1431a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27002025-01-09T01:04:54.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ec1bd616-8b00-4542-9413-03b5b8f1431a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27012025-01-09T01:04:55.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d1b24a34-b37a-4a6f-9234-aa4febf7d3cb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27022025-01-09T01:04:55.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d1b24a34-b37a-4a6f-9234-aa4febf7d3cb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27032025-01-09T01:04:55.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d1b24a34-b37a-4a6f-9234-aa4febf7d3cb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27042025-01-09T01:04:56.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16b01f3f-62ac-461b-bb37-54ce0f82e251 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27052025-01-09T01:04:56.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16b01f3f-62ac-461b-bb37-54ce0f82e251 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27062025-01-09T01:04:56.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16b01f3f-62ac-461b-bb37-54ce0f82e251 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27072025-01-09T01:04:56.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
27082025-01-09T01:04:56.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
27092025-01-09T01:04:56.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27102025-01-09T01:04:56.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27112025-01-09T01:04:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27122025-01-09T01:04:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27132025-01-09T01:04:56.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27142025-01-09T01:04:56.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27152025-01-09T01:04:56.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27162025-01-09T01:04:56.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.105858ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27172025-01-09T01:04:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27182025-01-09T01:04:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27192025-01-09T01:04:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27202025-01-09T01:04:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27212025-01-09T01:04:56.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27222025-01-09T01:04:56.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232025-01-09T01:04:56.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
27242025-01-09T01:04:56.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27252025-01-09T01:04:56.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27262025-01-09T01:04:56.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
27272025-01-09T01:04:56.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.722265ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
27282025-01-09T01:04:57.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7421f8c6-489e-48e8-9b32-d5a407a1dbb9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27292025-01-09T01:04:57.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7421f8c6-489e-48e8-9b32-d5a407a1dbb9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27302025-01-09T01:04:57.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7421f8c6-489e-48e8-9b32-d5a407a1dbb9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27312025-01-09T01:04:58.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2c2c792d-e94a-42d3-afeb-7db43cb60b03 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27322025-01-09T01:04:58.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2c2c792d-e94a-42d3-afeb-7db43cb60b03 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27332025-01-09T01:04:58.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2c2c792d-e94a-42d3-afeb-7db43cb60b03 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27342025-01-09T01:04:59.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0a30419-d37f-4f1d-a36a-107ba13ebd81 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27352025-01-09T01:04:59.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0a30419-d37f-4f1d-a36a-107ba13ebd81 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27362025-01-09T01:04:59.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0a30419-d37f-4f1d-a36a-107ba13ebd81 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27372025-01-09T01:05:00.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5cdcd71-6875-4904-8320-43376064e543 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27382025-01-09T01:05:00.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5cdcd71-6875-4904-8320-43376064e543 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27392025-01-09T01:05:00.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5cdcd71-6875-4904-8320-43376064e543 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27402025-01-09T01:05:02.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a065256c-316a-4076-b1d2-24aa161dc104 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27412025-01-09T01:05:02.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a065256c-316a-4076-b1d2-24aa161dc104 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27422025-01-09T01:05:02.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a065256c-316a-4076-b1d2-24aa161dc104 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27432025-01-09T01:05:03.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7719966-8b7b-46bf-a842-9a0bb2cca5cf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27442025-01-09T01:05:03.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7719966-8b7b-46bf-a842-9a0bb2cca5cf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27452025-01-09T01:05:03.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7719966-8b7b-46bf-a842-9a0bb2cca5cf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27462025-01-09T01:05:04.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5793b0a6-7f4e-4f14-9ef0-8451323374dd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27472025-01-09T01:05:04.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5793b0a6-7f4e-4f14-9ef0-8451323374dd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27482025-01-09T01:05:04.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5793b0a6-7f4e-4f14-9ef0-8451323374dd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27492025-01-09T01:05:05.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7309364-8360-4d93-a5a2-baef3b833dea roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27502025-01-09T01:05:05.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7309364-8360-4d93-a5a2-baef3b833dea resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27512025-01-09T01:05:05.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7309364-8360-4d93-a5a2-baef3b833dea response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27522025-01-09T01:05:06.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a70f2344-942f-472d-965a-16a9ba071c5d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27532025-01-09T01:05:06.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a70f2344-942f-472d-965a-16a9ba071c5d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27542025-01-09T01:05:06.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a70f2344-942f-472d-965a-16a9ba071c5d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27552025-01-09T01:05:06.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
27562025-01-09T01:05:06.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
27572025-01-09T01:05:06.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27582025-01-09T01:05:06.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27592025-01-09T01:05:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27602025-01-09T01:05:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27612025-01-09T01:05:06.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27622025-01-09T01:05:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27632025-01-09T01:05:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27642025-01-09T01:05:06.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.97593ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27652025-01-09T01:05:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27662025-01-09T01:05:06.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27672025-01-09T01:05:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27682025-01-09T01:05:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27692025-01-09T01:05:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27702025-01-09T01:05:06.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27712025-01-09T01:05:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
27722025-01-09T01:05:06.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27732025-01-09T01:05:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27742025-01-09T01:05:06.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
27752025-01-09T01:05:06.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.547296ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
27762025-01-09T01:05:07.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dbbd3815-bf77-4ddd-8f19-089cc8c7894d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27772025-01-09T01:05:07.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dbbd3815-bf77-4ddd-8f19-089cc8c7894d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27782025-01-09T01:05:07.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dbbd3815-bf77-4ddd-8f19-089cc8c7894d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27792025-01-09T01:05:08.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 861be133-0502-4c4f-a68a-1674caae9a37 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27802025-01-09T01:05:08.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 861be133-0502-4c4f-a68a-1674caae9a37 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27812025-01-09T01:05:08.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 861be133-0502-4c4f-a68a-1674caae9a37 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27822025-01-09T01:05:09.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 198c34b2-660c-441b-920a-06fd4f856f1a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27832025-01-09T01:05:09.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 198c34b2-660c-441b-920a-06fd4f856f1a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27842025-01-09T01:05:09.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 198c34b2-660c-441b-920a-06fd4f856f1a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27852025-01-09T01:05:09.940ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:35467 remote_addr = [fd00:1122:3344:101::d]:43603
27862025-01-09T01:05:09.946ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5536 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = b38a0661-92b6-4c7e-8f60-b6c6fe8c6515 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
27872025-01-09T01:05:10.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21d6b163-d65c-4ceb-9fb0-39c346b43b9a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27882025-01-09T01:05:10.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21d6b163-d65c-4ceb-9fb0-39c346b43b9a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27892025-01-09T01:05:10.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21d6b163-d65c-4ceb-9fb0-39c346b43b9a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27902025-01-09T01:05:11.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bd31e8b7-8ed5-4fba-8e9d-a108396c9715 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27912025-01-09T01:05:11.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bd31e8b7-8ed5-4fba-8e9d-a108396c9715 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27922025-01-09T01:05:11.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bd31e8b7-8ed5-4fba-8e9d-a108396c9715 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27932025-01-09T01:05:12.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff0a4318-61eb-4a49-a946-3a488c51a4b9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27942025-01-09T01:05:12.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff0a4318-61eb-4a49-a946-3a488c51a4b9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27952025-01-09T01:05:12.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff0a4318-61eb-4a49-a946-3a488c51a4b9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27962025-01-09T01:05:13.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0a7aad1b-da63-4f32-9c12-2aaae65a9d34 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27972025-01-09T01:05:13.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0a7aad1b-da63-4f32-9c12-2aaae65a9d34 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27982025-01-09T01:05:13.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0a7aad1b-da63-4f32-9c12-2aaae65a9d34 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
27992025-01-09T01:05:14.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb4421d2-5ed7-488a-a931-ba9b742146b5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28002025-01-09T01:05:14.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb4421d2-5ed7-488a-a931-ba9b742146b5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28012025-01-09T01:05:14.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb4421d2-5ed7-488a-a931-ba9b742146b5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28022025-01-09T01:05:15.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 69c9884a-1362-4e87-ba51-4e99b6651084 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28032025-01-09T01:05:15.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 69c9884a-1362-4e87-ba51-4e99b6651084 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28042025-01-09T01:05:15.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 69c9884a-1362-4e87-ba51-4e99b6651084 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28052025-01-09T01:05:16.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 32a75de1-8657-4165-aaec-ea77e6e3570a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28062025-01-09T01:05:16.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 32a75de1-8657-4165-aaec-ea77e6e3570a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28072025-01-09T01:05:16.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 32a75de1-8657-4165-aaec-ea77e6e3570a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
28082025-01-09T01:05:16.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
28092025-01-09T01:05:16.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28102025-01-09T01:05:16.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
28112025-01-09T01:05:16.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28122025-01-09T01:05:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28132025-01-09T01:05:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28142025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
28152025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28162025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
28172025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
28182025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28192025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28202025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
28212025-01-09T01:05:16.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28222025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
28232025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28242025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
28252025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28262025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28272025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
28282025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
28292025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28302025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28312025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28322025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
28332025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28342025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
28352025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
28362025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
28372025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28382025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28392025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
28402025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28412025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
28422025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28432025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
28442025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28452025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28462025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28472025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28482025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28492025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28502025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28512025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28522025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28532025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28542025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28552025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28562025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28572025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28582025-01-09T01:05:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28592025-01-09T01:05:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1160, tv_nsec: 363739995 } })
28602025-01-09T01:05:16.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612025-01-09T01:05:16.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
28622025-01-09T01:05:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28632025-01-09T01:05:16.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28642025-01-09T01:05:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28652025-01-09T01:05:16.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28662025-01-09T01:05:16.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28672025-01-09T01:05:16.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28682025-01-09T01:05:16.911ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1160, tv_nsec: 372519393 } })
28692025-01-09T01:05:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28702025-01-09T01:05:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28712025-01-09T01:05:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28722025-01-09T01:05:16.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
28732025-01-09T01:05:16.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28742025-01-09T01:05:16.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28752025-01-09T01:05:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28762025-01-09T01:05:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28772025-01-09T01:05:16.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28782025-01-09T01:05:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28792025-01-09T01:05:16.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28802025-01-09T01:05:16.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28812025-01-09T01:05:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28822025-01-09T01:05:16.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28832025-01-09T01:05:16.917ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1160, tv_nsec: 378013677 } })
28842025-01-09T01:05:16.917ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
28852025-01-09T01:05:16.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28862025-01-09T01:05:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28872025-01-09T01:05:16.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28882025-01-09T01:05:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28892025-01-09T01:05:16.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28902025-01-09T01:05:16.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28912025-01-09T01:05:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28922025-01-09T01:05:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28932025-01-09T01:05:16.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28942025-01-09T01:05:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28952025-01-09T01:05:16.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28962025-01-09T01:05:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
28972025-01-09T01:05:16.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28982025-01-09T01:05:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28992025-01-09T01:05:16.940ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
29002025-01-09T01:05:16.940ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.547975ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
29012025-01-09T01:05:16.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.263426ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
29022025-01-09T01:05:16.948ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29032025-01-09T01:05:16.948ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29042025-01-09T01:05:16.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29052025-01-09T01:05:16.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29062025-01-09T01:05:16.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29072025-01-09T01:05:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29082025-01-09T01:05:16.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29092025-01-09T01:05:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29102025-01-09T01:05:16.952ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29112025-01-09T01:05:16.952ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29122025-01-09T01:05:16.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29132025-01-09T01:05:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29142025-01-09T01:05:16.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.701405ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29152025-01-09T01:05:16.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29162025-01-09T01:05:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29172025-01-09T01:05:16.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29182025-01-09T01:05:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29192025-01-09T01:05:16.968ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29202025-01-09T01:05:16.968ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.710311ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29212025-01-09T01:05:16.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29222025-01-09T01:05:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29232025-01-09T01:05:16.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29242025-01-09T01:05:16.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29252025-01-09T01:05:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29262025-01-09T01:05:16.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29272025-01-09T01:05:16.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29282025-01-09T01:05:16.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29292025-01-09T01:05:16.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29302025-01-09T01:05:16.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29312025-01-09T01:05:16.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.666278ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29322025-01-09T01:05:16.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29332025-01-09T01:05:16.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29342025-01-09T01:05:16.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29352025-01-09T01:05:16.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29362025-01-09T01:05:16.995ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29372025-01-09T01:05:16.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29382025-01-09T01:05:16.997ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29392025-01-09T01:05:16.997ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29402025-01-09T01:05:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.686714ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29412025-01-09T01:05:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 112.945779ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
29422025-01-09T01:05:17.018ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 118.562815ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29432025-01-09T01:05:17.020ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29442025-01-09T01:05:17.020ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29452025-01-09T01:05:17.020ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76d9edf2-cad1-43b8-b819-f29fa2cd2494", "content-length": "26", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
29462025-01-09T01:05:17.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29472025-01-09T01:05:17.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29482025-01-09T01:05:17.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29492025-01-09T01:05:17.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29502025-01-09T01:05:17.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29512025-01-09T01:05:17.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29522025-01-09T01:05:17.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.743651ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29532025-01-09T01:05:17.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29542025-01-09T01:05:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29552025-01-09T01:05:17.062ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29562025-01-09T01:05:17.062ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29572025-01-09T01:05:17.063ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ac32a5-ee87-4a89-abeb-406074fdfb21", "content-length": "26", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
29582025-01-09T01:05:17.063ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29592025-01-09T01:05:17.064ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29602025-01-09T01:05:17.081ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.546846ms iteration = 6 status = {"physical_disks_added":0}
29612025-01-09T01:05:17.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
29622025-01-09T01:05:17.117ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29632025-01-09T01:05:17.117ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "141b7eed-77d3-4757-bd11-22b21f393ff5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
29642025-01-09T01:05:17.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29652025-01-09T01:05:17.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
29662025-01-09T01:05:17.145ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29672025-01-09T01:05:17.145ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29682025-01-09T01:05:17.145ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "63b83492-f804-4168-a6e6-951466ac6321", "content-length": "372", "date": "Thu, 09 Jan 2025 01:05:17 GMT"} })
29692025-01-09T01:05:17.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29702025-01-09T01:05:17.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29712025-01-09T01:05:17.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 247.613067ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29722025-01-09T01:05:17.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29732025-01-09T01:05:17.160ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29742025-01-09T01:05:17.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29752025-01-09T01:05:17.160ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "13296990-ba83-4ad1-8db3-74c800936311", "content-length": "1", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
29762025-01-09T01:05:17.162ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29772025-01-09T01:05:17.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29782025-01-09T01:05:17.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29792025-01-09T01:05:17.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29802025-01-09T01:05:17.163ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.896387ms iteration = 4 status = null
29812025-01-09T01:05:17.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29822025-01-09T01:05:17.169ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eb0a9ee-687d-4132-9eea-019a24fef28a", "content-length": "691", "date": "Thu, 09 Jan 2025 01:05:17 GMT"} })
29832025-01-09T01:05:17.169ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29842025-01-09T01:05:17.169ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29852025-01-09T01:05:17.169ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29862025-01-09T01:05:17.171ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.600507ms iteration = 4 status = {}
29872025-01-09T01:05:17.193ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29882025-01-09T01:05:17.193ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29892025-01-09T01:05:17.196ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902025-01-09T01:05:17.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a88bb974-27b0-4eb1-b331-7ad43f948ae1", "date": "Thu, 09 Jan 2025 01:05:17 GMT"} })
29912025-01-09T01:05:17.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29922025-01-09T01:05:17.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29932025-01-09T01:05:17.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29942025-01-09T01:05:17.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29952025-01-09T01:05:17.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
29962025-01-09T01:05:17.199ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29972025-01-09T01:05:17.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29982025-01-09T01:05:17.200ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 301.332249ms iteration = 4 status = {}
29992025-01-09T01:05:17.201ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 301.169105ms iteration = 4 status = 0
30002025-01-09T01:05:17.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30012025-01-09T01:05:17.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30022025-01-09T01:05:17.204ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30032025-01-09T01:05:17.204ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30042025-01-09T01:05:17.209ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "665f70ab-2dc7-4901-ad7b-ef9c2f5c7f47", "date": "Thu, 09 Jan 2025 01:05:17 GMT"} })
30052025-01-09T01:05:17.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 311.109589ms iteration = 4 status = {}
30062025-01-09T01:05:17.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30072025-01-09T01:05:17.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30082025-01-09T01:05:17.277ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
30092025-01-09T01:05:17.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30102025-01-09T01:05:17.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30112025-01-09T01:05:17.285ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30122025-01-09T01:05:17.285ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "436ef5f8-e273-4c49-99f1-5010e6903fc3", "content-length": "134", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
30132025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30142025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
30152025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30162025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30172025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30182025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30192025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30202025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30212025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30222025-01-09T01:05:17.285ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30232025-01-09T01:05:17.286ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
30242025-01-09T01:05:17.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30252025-01-09T01:05:17.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30262025-01-09T01:05:17.288ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30272025-01-09T01:05:17.288ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "14298112-bd7f-49a2-8e18-64a32fec2d48", "content-length": "2", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
30282025-01-09T01:05:17.288ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30292025-01-09T01:05:17.288ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "144cdac2-a907-41a7-8000-3eebaf6c7d29", "content-length": "52", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
30302025-01-09T01:05:17.288ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
30312025-01-09T01:05:17.288ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30322025-01-09T01:05:17.385ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2d2980a9-7d41-4b26-9715-9f77e87d0ab1", "date": "Thu, 09 Jan 2025 01:05:16 GMT"} })
30332025-01-09T01:05:17.385ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
30342025-01-09T01:05:17.385ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30352025-01-09T01:05:17.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3754794-98e8-4d3d-b55b-1d594dc01535 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30362025-01-09T01:05:17.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3754794-98e8-4d3d-b55b-1d594dc01535 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30372025-01-09T01:05:17.385ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "65beb2ec-00ae-4314-b0a2-426396cad28a", "content-length": "682", "date": "Thu, 09 Jan 2025 01:05:17 GMT"} })
30382025-01-09T01:05:17.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30392025-01-09T01:05:17.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30402025-01-09T01:05:17.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3754794-98e8-4d3d-b55b-1d594dc01535 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30412025-01-09T01:05:17.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30422025-01-09T01:05:17.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30432025-01-09T01:05:17.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30442025-01-09T01:05:17.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30452025-01-09T01:05:17.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30462025-01-09T01:05:17.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30472025-01-09T01:05:17.408ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 508.024861ms iteration = 4 status = {}
30482025-01-09T01:05:18.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 99dd9b2d-0a0f-4471-ae3d-4323b5ca20a9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30492025-01-09T01:05:18.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 99dd9b2d-0a0f-4471-ae3d-4323b5ca20a9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30502025-01-09T01:05:18.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 99dd9b2d-0a0f-4471-ae3d-4323b5ca20a9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30512025-01-09T01:05:19.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcdf5687-680d-4742-acc2-fa89abf5dbe2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30522025-01-09T01:05:19.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcdf5687-680d-4742-acc2-fa89abf5dbe2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30532025-01-09T01:05:19.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcdf5687-680d-4742-acc2-fa89abf5dbe2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30542025-01-09T01:05:19.940ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = b58b5639-7072-44cc-88e5-b8e981d6dcac response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
30552025-01-09T01:05:20.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 88c422aa-f0d6-4f4e-8dfe-ded0a7a69758 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30562025-01-09T01:05:20.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 88c422aa-f0d6-4f4e-8dfe-ded0a7a69758 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30572025-01-09T01:05:20.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 88c422aa-f0d6-4f4e-8dfe-ded0a7a69758 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30582025-01-09T01:05:21.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d5427ff2-f407-4816-9cd6-51c1938bb643 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30592025-01-09T01:05:21.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d5427ff2-f407-4816-9cd6-51c1938bb643 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30602025-01-09T01:05:21.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d5427ff2-f407-4816-9cd6-51c1938bb643 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30612025-01-09T01:05:22.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3fa704ac-ae9d-4aa6-a412-ffefa1f916ad roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30622025-01-09T01:05:22.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3fa704ac-ae9d-4aa6-a412-ffefa1f916ad resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30632025-01-09T01:05:22.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3fa704ac-ae9d-4aa6-a412-ffefa1f916ad response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30642025-01-09T01:05:23.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a0243dc0-b91f-4474-b6dc-902fda2fafc7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30652025-01-09T01:05:23.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a0243dc0-b91f-4474-b6dc-902fda2fafc7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30662025-01-09T01:05:23.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a0243dc0-b91f-4474-b6dc-902fda2fafc7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30672025-01-09T01:05:24.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3c317e94-2f45-46cf-b1e6-b02798cc955a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30682025-01-09T01:05:24.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3c317e94-2f45-46cf-b1e6-b02798cc955a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30692025-01-09T01:05:24.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3c317e94-2f45-46cf-b1e6-b02798cc955a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30702025-01-09T01:05:25.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca0ecff7-29b7-4894-ab31-1019602c94cc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30712025-01-09T01:05:25.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca0ecff7-29b7-4894-ab31-1019602c94cc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30722025-01-09T01:05:25.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca0ecff7-29b7-4894-ab31-1019602c94cc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30732025-01-09T01:05:26.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 987e8685-70b0-4fae-b4d3-9be1715bdc9f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30742025-01-09T01:05:26.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 987e8685-70b0-4fae-b4d3-9be1715bdc9f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30752025-01-09T01:05:26.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 987e8685-70b0-4fae-b4d3-9be1715bdc9f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30762025-01-09T01:05:26.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
30772025-01-09T01:05:26.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30782025-01-09T01:05:26.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
30792025-01-09T01:05:26.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30802025-01-09T01:05:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30812025-01-09T01:05:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30822025-01-09T01:05:26.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30832025-01-09T01:05:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30842025-01-09T01:05:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30852025-01-09T01:05:26.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.849866ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30862025-01-09T01:05:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30872025-01-09T01:05:26.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30882025-01-09T01:05:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30892025-01-09T01:05:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30902025-01-09T01:05:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30912025-01-09T01:05:26.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30922025-01-09T01:05:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
30932025-01-09T01:05:26.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30942025-01-09T01:05:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30952025-01-09T01:05:27.013ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
30962025-01-09T01:05:27.013ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.061931ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
30972025-01-09T01:05:27.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2927d2c4-e47e-425e-a4fa-a5b2b0782832 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30982025-01-09T01:05:27.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2927d2c4-e47e-425e-a4fa-a5b2b0782832 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
30992025-01-09T01:05:27.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2927d2c4-e47e-425e-a4fa-a5b2b0782832 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31002025-01-09T01:05:28.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 119c01c6-3f5c-4ed5-9ce8-5c78eeaf35a9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31012025-01-09T01:05:28.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 119c01c6-3f5c-4ed5-9ce8-5c78eeaf35a9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31022025-01-09T01:05:28.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 119c01c6-3f5c-4ed5-9ce8-5c78eeaf35a9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31032025-01-09T01:05:29.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b8575fb-5ee6-472a-bd28-6513ea69bfa4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31042025-01-09T01:05:29.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b8575fb-5ee6-472a-bd28-6513ea69bfa4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31052025-01-09T01:05:29.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b8575fb-5ee6-472a-bd28-6513ea69bfa4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31062025-01-09T01:05:29.940ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 450 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 07f40b6d-6ea7-4d0d-b984-5bb51a85c6ee response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
31072025-01-09T01:05:30.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d87a68b5-7f83-428b-902e-e18060a13daf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31082025-01-09T01:05:30.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d87a68b5-7f83-428b-902e-e18060a13daf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31092025-01-09T01:05:30.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d87a68b5-7f83-428b-902e-e18060a13daf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31102025-01-09T01:05:31.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6f95f2ff-ee8a-41e4-b042-9a64f2dd8fb7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31112025-01-09T01:05:31.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6f95f2ff-ee8a-41e4-b042-9a64f2dd8fb7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31122025-01-09T01:05:31.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6f95f2ff-ee8a-41e4-b042-9a64f2dd8fb7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31132025-01-09T01:05:32.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea35238f-e77c-4119-a32e-56a52b0f948e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31142025-01-09T01:05:32.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea35238f-e77c-4119-a32e-56a52b0f948e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31152025-01-09T01:05:32.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea35238f-e77c-4119-a32e-56a52b0f948e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31162025-01-09T01:05:33.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 230a733d-9d2c-4cca-bd73-d18b3e9ce815 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31172025-01-09T01:05:33.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 230a733d-9d2c-4cca-bd73-d18b3e9ce815 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31182025-01-09T01:05:33.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 230a733d-9d2c-4cca-bd73-d18b3e9ce815 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31192025-01-09T01:05:34.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4746af07-c7e4-4101-b0a5-2cb63ba0f29d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31202025-01-09T01:05:34.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4746af07-c7e4-4101-b0a5-2cb63ba0f29d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31212025-01-09T01:05:34.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4746af07-c7e4-4101-b0a5-2cb63ba0f29d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31222025-01-09T01:05:35.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e9b79c30-e2a7-47bd-ac5e-8e6964bf0371 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31232025-01-09T01:05:35.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e9b79c30-e2a7-47bd-ac5e-8e6964bf0371 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31242025-01-09T01:05:35.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e9b79c30-e2a7-47bd-ac5e-8e6964bf0371 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31252025-01-09T01:05:36.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9edfaed-8c3c-47db-a072-8758b9d3d418 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31262025-01-09T01:05:36.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9edfaed-8c3c-47db-a072-8758b9d3d418 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31272025-01-09T01:05:36.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9edfaed-8c3c-47db-a072-8758b9d3d418 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31282025-01-09T01:05:36.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
31292025-01-09T01:05:36.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
31302025-01-09T01:05:36.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31312025-01-09T01:05:36.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31322025-01-09T01:05:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31332025-01-09T01:05:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31342025-01-09T01:05:36.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31352025-01-09T01:05:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31362025-01-09T01:05:36.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372025-01-09T01:05:36.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.449497ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31382025-01-09T01:05:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31392025-01-09T01:05:36.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31402025-01-09T01:05:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31412025-01-09T01:05:36.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31422025-01-09T01:05:36.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31432025-01-09T01:05:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442025-01-09T01:05:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
31452025-01-09T01:05:36.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31462025-01-09T01:05:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31472025-01-09T01:05:36.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
31482025-01-09T01:05:36.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.882776ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
31492025-01-09T01:05:37.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 587d8acc-9c5e-4e87-9d52-a8af2c5c59b9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31502025-01-09T01:05:37.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 587d8acc-9c5e-4e87-9d52-a8af2c5c59b9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31512025-01-09T01:05:37.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 587d8acc-9c5e-4e87-9d52-a8af2c5c59b9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31522025-01-09T01:05:38.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 61091663-5582-4861-a03a-c24901679c48 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31532025-01-09T01:05:38.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 61091663-5582-4861-a03a-c24901679c48 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31542025-01-09T01:05:38.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 61091663-5582-4861-a03a-c24901679c48 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31552025-01-09T01:05:39.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6f0f0b80-f44c-4032-bfea-f458fe56cde2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31562025-01-09T01:05:39.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6f0f0b80-f44c-4032-bfea-f458fe56cde2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31572025-01-09T01:05:39.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6f0f0b80-f44c-4032-bfea-f458fe56cde2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31582025-01-09T01:05:39.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 40ff9078-a2d5-462f-a518-6813b8b3f9c4 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
31592025-01-09T01:05:40.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ca088aa-2cd6-4919-aa04-c7fa1421cb3e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31602025-01-09T01:05:40.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ca088aa-2cd6-4919-aa04-c7fa1421cb3e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31612025-01-09T01:05:40.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ca088aa-2cd6-4919-aa04-c7fa1421cb3e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31622025-01-09T01:05:41.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d75857d7-e91f-4423-adaa-2684dd91941e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31632025-01-09T01:05:41.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d75857d7-e91f-4423-adaa-2684dd91941e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31642025-01-09T01:05:41.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d75857d7-e91f-4423-adaa-2684dd91941e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31652025-01-09T01:05:42.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b5e5d114-1fd3-471a-9373-6ce942bb04fd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31662025-01-09T01:05:42.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b5e5d114-1fd3-471a-9373-6ce942bb04fd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31672025-01-09T01:05:42.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b5e5d114-1fd3-471a-9373-6ce942bb04fd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31682025-01-09T01:05:43.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e993f72-280e-4d82-981c-1549038d0e1d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31692025-01-09T01:05:43.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e993f72-280e-4d82-981c-1549038d0e1d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31702025-01-09T01:05:43.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e993f72-280e-4d82-981c-1549038d0e1d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31712025-01-09T01:05:44.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3c1f271-0993-4eca-b966-22f41f52a603 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31722025-01-09T01:05:44.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3c1f271-0993-4eca-b966-22f41f52a603 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31732025-01-09T01:05:44.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3c1f271-0993-4eca-b966-22f41f52a603 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31742025-01-09T01:05:46.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8f1d995-43b8-4721-8ad4-80efbf47de0a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31752025-01-09T01:05:46.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8f1d995-43b8-4721-8ad4-80efbf47de0a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31762025-01-09T01:05:46.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8f1d995-43b8-4721-8ad4-80efbf47de0a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
31772025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
31782025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31792025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
31802025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31812025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31822025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
31832025-01-09T01:05:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:55:46.899188107 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31842025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31852025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
31862025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
31872025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31882025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
31892025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31902025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
31912025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31922025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31932025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
31942025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
31952025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
31962025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31972025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31982025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31992025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32002025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
32012025-01-09T01:05:46.899ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32022025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32032025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
32042025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32052025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
32062025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32072025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
32082025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32092025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32102025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
32112025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32122025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
32132025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32142025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
32152025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
32162025-01-09T01:05:46.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32172025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32182025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
32192025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32202025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32212025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
32222025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32232025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
32242025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32252025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
32262025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32272025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
32282025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32292025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
32302025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32312025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
32322025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32332025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
32342025-01-09T01:05:46.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
32352025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.311\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
32362025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
32372025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
32382025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32392025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32402025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32412025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32422025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32432025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32442025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32452025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32462025-01-09T01:05:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32472025-01-09T01:05:46.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 360678647 } })
32482025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32492025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32502025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32512025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32522025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32532025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32542025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32552025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32562025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32572025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32582025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32592025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32602025-01-09T01:05:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 360858271 } })
32612025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32622025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32632025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32642025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32652025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32662025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.28863ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32672025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32682025-01-09T01:05:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.413972ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32692025-01-09T01:05:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32702025-01-09T01:05:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32712025-01-09T01:05:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32722025-01-09T01:05:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32732025-01-09T01:05:46.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 363969441 } })
32742025-01-09T01:05:46.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
32752025-01-09T01:05:46.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:55:46.899188107 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32762025-01-09T01:05:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.751939ms iteration = 3 status = {"expiration":"2025-01-09T00:55:46.899188107Z","pruned":[]}
32772025-01-09T01:05:46.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 366146711 } })
32782025-01-09T01:05:46.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32792025-01-09T01:05:46.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32802025-01-09T01:05:46.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32812025-01-09T01:05:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32822025-01-09T01:05:46.906ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32832025-01-09T01:05:46.906ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32842025-01-09T01:05:46.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32852025-01-09T01:05:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32862025-01-09T01:05:46.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872025-01-09T01:05:46.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32882025-01-09T01:05:46.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32892025-01-09T01:05:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32902025-01-09T01:05:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32912025-01-09T01:05:46.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32922025-01-09T01:05:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32932025-01-09T01:05:46.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32942025-01-09T01:05:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32952025-01-09T01:05:46.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32962025-01-09T01:05:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32972025-01-09T01:05:46.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982025-01-09T01:05:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32992025-01-09T01:05:46.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33002025-01-09T01:05:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33012025-01-09T01:05:46.916ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33022025-01-09T01:05:46.916ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33032025-01-09T01:05:46.916ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.630115ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33042025-01-09T01:05:46.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33052025-01-09T01:05:46.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33062025-01-09T01:05:46.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072025-01-09T01:05:46.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.261407ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
33082025-01-09T01:05:46.920ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.836991ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
33092025-01-09T01:05:46.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33102025-01-09T01:05:46.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33112025-01-09T01:05:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33122025-01-09T01:05:46.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33132025-01-09T01:05:46.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33142025-01-09T01:05:46.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33152025-01-09T01:05:46.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33162025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33172025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33182025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33192025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33202025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33212025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33222025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33232025-01-09T01:05:46.929ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33242025-01-09T01:05:46.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33252025-01-09T01:05:46.931ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 391907942 } })
33262025-01-09T01:05:46.931ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
33272025-01-09T01:05:46.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 32.165956ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33282025-01-09T01:05:46.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33292025-01-09T01:05:46.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33302025-01-09T01:05:46.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33312025-01-09T01:05:46.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322025-01-09T01:05:46.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33332025-01-09T01:05:46.939ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33342025-01-09T01:05:46.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33352025-01-09T01:05:46.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33362025-01-09T01:05:46.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33372025-01-09T01:05:46.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
33382025-01-09T01:05:46.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33392025-01-09T01:05:46.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33402025-01-09T01:05:46.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33412025-01-09T01:05:46.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33422025-01-09T01:05:46.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33432025-01-09T01:05:46.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33442025-01-09T01:05:46.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33452025-01-09T01:05:46.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33462025-01-09T01:05:46.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.06569ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
33472025-01-09T01:05:46.963ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
33482025-01-09T01:05:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.902221ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
33492025-01-09T01:05:46.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33502025-01-09T01:05:46.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33512025-01-09T01:05:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33522025-01-09T01:05:46.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33532025-01-09T01:05:46.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33542025-01-09T01:05:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33552025-01-09T01:05:46.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33562025-01-09T01:05:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33572025-01-09T01:05:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33582025-01-09T01:05:46.970ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33592025-01-09T01:05:46.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33602025-01-09T01:05:46.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33612025-01-09T01:05:46.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33622025-01-09T01:05:46.972ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33632025-01-09T01:05:46.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33642025-01-09T01:05:46.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33652025-01-09T01:05:46.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33662025-01-09T01:05:46.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33672025-01-09T01:05:46.976ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33682025-01-09T01:05:46.976ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33692025-01-09T01:05:46.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33702025-01-09T01:05:46.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33712025-01-09T01:05:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33722025-01-09T01:05:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33732025-01-09T01:05:46.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33742025-01-09T01:05:46.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33752025-01-09T01:05:46.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33762025-01-09T01:05:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33772025-01-09T01:05:46.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.843344ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33782025-01-09T01:05:46.981ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33792025-01-09T01:05:46.981ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33802025-01-09T01:05:46.981ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.367749ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33812025-01-09T01:05:46.983ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33822025-01-09T01:05:46.983ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.808901ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33832025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33842025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33852025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33862025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33872025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33882025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33892025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
33902025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33912025-01-09T01:05:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33922025-01-09T01:05:46.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33932025-01-09T01:05:46.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33942025-01-09T01:05:47.007ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 108.308933ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33952025-01-09T01:05:47.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.977379ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33962025-01-09T01:05:47.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33972025-01-09T01:05:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33982025-01-09T01:05:47.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.47086ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
33992025-01-09T01:05:47.017ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34002025-01-09T01:05:47.017ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34012025-01-09T01:05:47.017ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.432332ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34022025-01-09T01:05:47.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34032025-01-09T01:05:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34042025-01-09T01:05:47.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34052025-01-09T01:05:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34062025-01-09T01:05:47.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 874406b1-3c81-46b0-a1fa-f20dc807e8ee roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
34072025-01-09T01:05:47.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 874406b1-3c81-46b0-a1fa-f20dc807e8ee resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
34082025-01-09T01:05:47.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34092025-01-09T01:05:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34102025-01-09T01:05:47.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34112025-01-09T01:05:47.073ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34122025-01-09T01:05:47.074ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f081c847-e6fc-4ad8-923d-ec83384af9c5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:05:46 GMT"} })
34132025-01-09T01:05:47.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34142025-01-09T01:05:47.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34152025-01-09T01:05:47.077ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34162025-01-09T01:05:47.079ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 180.450391ms iteration = 7 status = {"physical_disks_added":0}
34172025-01-09T01:05:47.107ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
34182025-01-09T01:05:47.107ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34192025-01-09T01:05:47.107ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af5f82fd-744a-4e5b-8ed9-bff9265d2c60", "content-length": "26", "date": "Thu, 09 Jan 2025 01:05:46 GMT"} })
34202025-01-09T01:05:47.107ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34212025-01-09T01:05:47.109ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
34222025-01-09T01:05:47.158ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34232025-01-09T01:05:47.158ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34242025-01-09T01:05:47.158ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b36a9d2-3ce8-4fb4-b561-e43bdf342356", "content-length": "372", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
34252025-01-09T01:05:47.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34262025-01-09T01:05:47.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34272025-01-09T01:05:47.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282025-01-09T01:05:47.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34292025-01-09T01:05:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34302025-01-09T01:05:47.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34312025-01-09T01:05:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34322025-01-09T01:05:47.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34332025-01-09T01:05:47.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34342025-01-09T01:05:47.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34352025-01-09T01:05:47.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 874406b1-3c81-46b0-a1fa-f20dc807e8ee response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
34362025-01-09T01:05:47.168ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
34372025-01-09T01:05:47.168ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34382025-01-09T01:05:47.168ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
34392025-01-09T01:05:47.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 268.788344ms iteration = 3 status = {"generation":2}
34402025-01-09T01:05:47.184ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34412025-01-09T01:05:47.184ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34422025-01-09T01:05:47.184ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dd9dd6ba-2d2b-476e-955e-8a11f266ed06", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
34432025-01-09T01:05:47.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34442025-01-09T01:05:47.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34452025-01-09T01:05:47.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34462025-01-09T01:05:47.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34472025-01-09T01:05:47.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34482025-01-09T01:05:47.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34492025-01-09T01:05:47.195ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34502025-01-09T01:05:47.195ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34512025-01-09T01:05:47.195ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1e034909-87fe-4a8d-b786-1153d87c2fac", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
34522025-01-09T01:05:47.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34532025-01-09T01:05:47.197ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 298.065035ms iteration = 5 status = {}
34542025-01-09T01:05:47.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34552025-01-09T01:05:47.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34562025-01-09T01:05:47.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34572025-01-09T01:05:47.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34582025-01-09T01:05:47.205ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34592025-01-09T01:05:47.205ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34602025-01-09T01:05:47.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34612025-01-09T01:05:47.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622025-01-09T01:05:47.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34632025-01-09T01:05:47.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642025-01-09T01:05:47.207ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34652025-01-09T01:05:47.207ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34662025-01-09T01:05:47.207ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c2cdbbd-470b-4a45-99e5-c0f2bb7950ba", "content-length": "26", "date": "Thu, 09 Jan 2025 01:05:46 GMT"} })
34672025-01-09T01:05:47.207ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34682025-01-09T01:05:47.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
34692025-01-09T01:05:47.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34702025-01-09T01:05:47.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34712025-01-09T01:05:47.210ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34722025-01-09T01:05:47.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34732025-01-09T01:05:47.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34742025-01-09T01:05:47.210ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 310.781721ms iteration = 5 status = 0
34752025-01-09T01:05:47.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34762025-01-09T01:05:47.210ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
34772025-01-09T01:05:47.210ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 311.650502ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34782025-01-09T01:05:47.213ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34792025-01-09T01:05:47.213ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34802025-01-09T01:05:47.213ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
34812025-01-09T01:05:47.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 314.25534ms iteration = 3 status = {"generation":1}
34822025-01-09T01:05:47.236ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34832025-01-09T01:05:47.237ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.748753ms iteration = 5 status = {}
34842025-01-09T01:05:47.264ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34852025-01-09T01:05:47.264ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 365.367764ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34862025-01-09T01:05:47.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34872025-01-09T01:05:47.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34882025-01-09T01:05:47.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34892025-01-09T01:05:47.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34902025-01-09T01:05:47.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34912025-01-09T01:05:47.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34922025-01-09T01:05:47.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932025-01-09T01:05:47.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34942025-01-09T01:05:47.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34952025-01-09T01:05:47.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34962025-01-09T01:05:47.340ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34972025-01-09T01:05:47.341ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a1d7193-1077-4513-b2bd-f45566347261", "content-length": "1", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
34982025-01-09T01:05:47.342ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34992025-01-09T01:05:47.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35002025-01-09T01:05:47.344ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 444.97842ms iteration = 5 status = null
35012025-01-09T01:05:47.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35022025-01-09T01:05:47.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "aea6ee4b-7867-47cb-a192-71c390d10c10", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35032025-01-09T01:05:47.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35042025-01-09T01:05:47.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eedeb54b-ac3d-46e6-851c-5c729a4cdc7c", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35052025-01-09T01:05:47.373ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35062025-01-09T01:05:47.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "576b5772-0fb5-45d2-83e6-a1b9d0c21052", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35072025-01-09T01:05:47.374ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35082025-01-09T01:05:47.376ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
35092025-01-09T01:05:47.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 477.135654ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35102025-01-09T01:05:47.384ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35112025-01-09T01:05:47.384ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "489aa820-44d1-47a8-943f-3b35a84d5485", "date": "Thu, 09 Jan 2025 01:05:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35122025-01-09T01:05:47.384ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35132025-01-09T01:05:47.386ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "962de0f7-5bf8-4105-8db9-493d2848c79f", "date": "Thu, 09 Jan 2025 01:05:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35142025-01-09T01:05:47.386ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35152025-01-09T01:05:47.388ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35162025-01-09T01:05:47.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 489.32841ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35172025-01-09T01:05:47.422ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35182025-01-09T01:05:47.423ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "05485b7f-6524-40f7-b5db-0a0bbab0ad66", "content-length": "691", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
35192025-01-09T01:05:47.423ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35202025-01-09T01:05:47.423ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35212025-01-09T01:05:47.423ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35222025-01-09T01:05:47.425ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 526.056168ms iteration = 5 status = {}
35232025-01-09T01:05:47.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35242025-01-09T01:05:47.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35252025-01-09T01:05:47.436ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
35262025-01-09T01:05:47.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35272025-01-09T01:05:47.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35282025-01-09T01:05:47.445ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35292025-01-09T01:05:47.445ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a0e8639-9226-4430-9326-c54d7b033fce", "content-length": "134", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
35302025-01-09T01:05:47.445ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35312025-01-09T01:05:47.445ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
35322025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35332025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35342025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35352025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35362025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35372025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35382025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35392025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35402025-01-09T01:05:47.446ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
35412025-01-09T01:05:47.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35422025-01-09T01:05:47.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35432025-01-09T01:05:47.448ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35442025-01-09T01:05:47.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "16c0f9c5-cde3-46ce-af71-835a6a318a51", "content-length": "2", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
35452025-01-09T01:05:47.448ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35462025-01-09T01:05:47.449ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3c0cb4-90ce-42d1-ba9e-d661764bf2ef", "content-length": "52", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
35472025-01-09T01:05:47.449ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
35482025-01-09T01:05:47.449ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35492025-01-09T01:05:47.546ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "835e4270-39cc-40d9-af75-36d653e6616e", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
35502025-01-09T01:05:47.546ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
35512025-01-09T01:05:47.546ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35522025-01-09T01:05:47.546ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd2bc2ee-83e8-496c-bfaa-d5bcbca618e7", "content-length": "682", "date": "Thu, 09 Jan 2025 01:05:47 GMT"} })
35532025-01-09T01:05:47.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35542025-01-09T01:05:47.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35552025-01-09T01:05:47.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35562025-01-09T01:05:47.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35572025-01-09T01:05:47.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35582025-01-09T01:05:47.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35592025-01-09T01:05:47.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35602025-01-09T01:05:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35612025-01-09T01:05:47.660ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 760.61437ms iteration = 5 status = {}
35622025-01-09T01:05:48.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 216c30a6-8c71-499a-9f8c-46f45f1aecdf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35632025-01-09T01:05:48.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 216c30a6-8c71-499a-9f8c-46f45f1aecdf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35642025-01-09T01:05:48.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 216c30a6-8c71-499a-9f8c-46f45f1aecdf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35652025-01-09T01:05:49.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 28bad403-41d3-4a19-94b4-65904b3aea9a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35662025-01-09T01:05:49.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 28bad403-41d3-4a19-94b4-65904b3aea9a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35672025-01-09T01:05:49.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 28bad403-41d3-4a19-94b4-65904b3aea9a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35682025-01-09T01:05:49.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 00163752-a64b-418b-94f6-39acdb702b91 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
35692025-01-09T01:05:50.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8662ec0-3a2c-48f7-92c6-6116867f5339 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35702025-01-09T01:05:50.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8662ec0-3a2c-48f7-92c6-6116867f5339 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35712025-01-09T01:05:50.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8662ec0-3a2c-48f7-92c6-6116867f5339 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35722025-01-09T01:05:51.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 585d5117-c914-490f-9809-77151dff04ce roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35732025-01-09T01:05:51.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 585d5117-c914-490f-9809-77151dff04ce resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35742025-01-09T01:05:51.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 585d5117-c914-490f-9809-77151dff04ce response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35752025-01-09T01:05:52.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b9c748f8-73bb-4701-855e-f01bbc42cda1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35762025-01-09T01:05:52.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b9c748f8-73bb-4701-855e-f01bbc42cda1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35772025-01-09T01:05:52.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b9c748f8-73bb-4701-855e-f01bbc42cda1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35782025-01-09T01:05:53.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ad2ca241-cd7b-40dc-824e-b02ece5708e4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35792025-01-09T01:05:53.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ad2ca241-cd7b-40dc-824e-b02ece5708e4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35802025-01-09T01:05:53.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ad2ca241-cd7b-40dc-824e-b02ece5708e4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35812025-01-09T01:05:54.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a5ac62d-9b04-429f-9f54-ccbc6a4b57f6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35822025-01-09T01:05:54.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a5ac62d-9b04-429f-9f54-ccbc6a4b57f6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35832025-01-09T01:05:54.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a5ac62d-9b04-429f-9f54-ccbc6a4b57f6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35842025-01-09T01:05:55.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bec43211-2277-4aae-95c7-c076925bca33 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35852025-01-09T01:05:55.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bec43211-2277-4aae-95c7-c076925bca33 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35862025-01-09T01:05:55.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bec43211-2277-4aae-95c7-c076925bca33 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35872025-01-09T01:05:56.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d62269b4-1f1a-4a01-8522-77488f9dde43 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35882025-01-09T01:05:56.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d62269b4-1f1a-4a01-8522-77488f9dde43 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35892025-01-09T01:05:56.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d62269b4-1f1a-4a01-8522-77488f9dde43 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
35902025-01-09T01:05:56.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
35912025-01-09T01:05:56.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
35922025-01-09T01:05:56.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35932025-01-09T01:05:56.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35942025-01-09T01:05:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35952025-01-09T01:05:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35962025-01-09T01:05:56.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35972025-01-09T01:05:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35982025-01-09T01:05:56.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35992025-01-09T01:05:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36002025-01-09T01:05:56.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012025-01-09T01:05:56.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36022025-01-09T01:05:56.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032025-01-09T01:05:56.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
36042025-01-09T01:05:56.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36052025-01-09T01:05:56.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36062025-01-09T01:05:56.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
36072025-01-09T01:05:56.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.219941ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
36082025-01-09T01:05:56.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36092025-01-09T01:05:56.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36102025-01-09T01:05:56.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.649728ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36112025-01-09T01:05:57.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b694c260-9f96-4ac2-9856-b710acb128a4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36122025-01-09T01:05:57.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b694c260-9f96-4ac2-9856-b710acb128a4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36132025-01-09T01:05:57.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b694c260-9f96-4ac2-9856-b710acb128a4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36142025-01-09T01:05:58.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b85da8d2-88c6-479d-9d6f-977d2517b659 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36152025-01-09T01:05:58.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b85da8d2-88c6-479d-9d6f-977d2517b659 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36162025-01-09T01:05:58.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b85da8d2-88c6-479d-9d6f-977d2517b659 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36172025-01-09T01:05:59.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f6869d3a-fd45-4f55-be2c-1ea8a0801d5c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36182025-01-09T01:05:59.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f6869d3a-fd45-4f55-be2c-1ea8a0801d5c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36192025-01-09T01:05:59.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f6869d3a-fd45-4f55-be2c-1ea8a0801d5c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36202025-01-09T01:05:59.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 9ded548f-47d3-458d-957c-abad26434c2a response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
36212025-01-09T01:06:00.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c123fa5e-2be5-4c18-b23f-cc49797c02ee roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36222025-01-09T01:06:00.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c123fa5e-2be5-4c18-b23f-cc49797c02ee resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36232025-01-09T01:06:00.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c123fa5e-2be5-4c18-b23f-cc49797c02ee response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36242025-01-09T01:06:01.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 136a993e-be5b-4b30-849d-3c6bfbb15ee0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36252025-01-09T01:06:01.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 136a993e-be5b-4b30-849d-3c6bfbb15ee0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36262025-01-09T01:06:01.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 136a993e-be5b-4b30-849d-3c6bfbb15ee0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36272025-01-09T01:06:02.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b5d42bdd-d963-4f36-8705-407c88eca2c2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36282025-01-09T01:06:02.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b5d42bdd-d963-4f36-8705-407c88eca2c2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36292025-01-09T01:06:02.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b5d42bdd-d963-4f36-8705-407c88eca2c2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36302025-01-09T01:06:03.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a102a9ba-7f06-44f4-8900-b8c23da0152c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36312025-01-09T01:06:03.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a102a9ba-7f06-44f4-8900-b8c23da0152c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36322025-01-09T01:06:03.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a102a9ba-7f06-44f4-8900-b8c23da0152c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36332025-01-09T01:06:04.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e781323e-6711-482c-9287-7cd0fbe5b5a8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36342025-01-09T01:06:04.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e781323e-6711-482c-9287-7cd0fbe5b5a8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36352025-01-09T01:06:04.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e781323e-6711-482c-9287-7cd0fbe5b5a8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36362025-01-09T01:06:05.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bda00e70-2c57-4350-9798-538952965291 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36372025-01-09T01:06:05.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bda00e70-2c57-4350-9798-538952965291 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36382025-01-09T01:06:05.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bda00e70-2c57-4350-9798-538952965291 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36392025-01-09T01:06:06.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bbc52fb5-d032-4279-bd24-806596757c55 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36402025-01-09T01:06:06.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bbc52fb5-d032-4279-bd24-806596757c55 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36412025-01-09T01:06:06.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bbc52fb5-d032-4279-bd24-806596757c55 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36422025-01-09T01:06:06.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
36432025-01-09T01:06:06.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36442025-01-09T01:06:06.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
36452025-01-09T01:06:06.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36462025-01-09T01:06:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36472025-01-09T01:06:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36482025-01-09T01:06:06.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36492025-01-09T01:06:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36502025-01-09T01:06:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512025-01-09T01:06:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36522025-01-09T01:06:06.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36532025-01-09T01:06:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36542025-01-09T01:06:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36552025-01-09T01:06:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36562025-01-09T01:06:06.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36572025-01-09T01:06:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
36582025-01-09T01:06:06.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36592025-01-09T01:06:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36602025-01-09T01:06:06.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
36612025-01-09T01:06:06.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.905964ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
36622025-01-09T01:06:06.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.050503ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36632025-01-09T01:06:07.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8af0f4b4-0b4c-4f32-9b1a-b69c18121e6d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36642025-01-09T01:06:07.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8af0f4b4-0b4c-4f32-9b1a-b69c18121e6d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36652025-01-09T01:06:07.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8af0f4b4-0b4c-4f32-9b1a-b69c18121e6d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36662025-01-09T01:06:08.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 05886e35-dc96-4ae4-aaa5-fe82faf8ac46 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36672025-01-09T01:06:08.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 05886e35-dc96-4ae4-aaa5-fe82faf8ac46 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36682025-01-09T01:06:08.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 05886e35-dc96-4ae4-aaa5-fe82faf8ac46 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36692025-01-09T01:06:09.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 243449a3-6fb1-454d-b994-b699494a4159 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36702025-01-09T01:06:09.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 243449a3-6fb1-454d-b994-b699494a4159 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36712025-01-09T01:06:09.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 243449a3-6fb1-454d-b994-b699494a4159 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36722025-01-09T01:06:09.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = b2d7177d-b097-4b3d-b055-5749e8da76ce response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
36732025-01-09T01:06:10.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b9698ac7-a6e0-4161-8731-f12e3d1765b9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36742025-01-09T01:06:10.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b9698ac7-a6e0-4161-8731-f12e3d1765b9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36752025-01-09T01:06:10.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b9698ac7-a6e0-4161-8731-f12e3d1765b9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36762025-01-09T01:06:11.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 720aaaea-b6ce-4216-81a2-958e9ce6e18b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36772025-01-09T01:06:11.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 720aaaea-b6ce-4216-81a2-958e9ce6e18b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36782025-01-09T01:06:11.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 720aaaea-b6ce-4216-81a2-958e9ce6e18b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36792025-01-09T01:06:12.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3482010e-0b76-484a-a774-01f3da30987d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36802025-01-09T01:06:12.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3482010e-0b76-484a-a774-01f3da30987d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36812025-01-09T01:06:12.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3482010e-0b76-484a-a774-01f3da30987d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36822025-01-09T01:06:13.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2012a3e8-ae2a-4e72-98e3-09b2f3c04abe roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36832025-01-09T01:06:13.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2012a3e8-ae2a-4e72-98e3-09b2f3c04abe resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36842025-01-09T01:06:13.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2012a3e8-ae2a-4e72-98e3-09b2f3c04abe response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36852025-01-09T01:06:14.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 11eae7a7-ef61-49df-a907-e655825a7f34 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36862025-01-09T01:06:14.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 11eae7a7-ef61-49df-a907-e655825a7f34 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36872025-01-09T01:06:14.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 11eae7a7-ef61-49df-a907-e655825a7f34 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36882025-01-09T01:06:15.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76256031-499c-477e-88f2-3a35fefca1c6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36892025-01-09T01:06:15.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76256031-499c-477e-88f2-3a35fefca1c6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36902025-01-09T01:06:15.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76256031-499c-477e-88f2-3a35fefca1c6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36912025-01-09T01:06:16.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff284979-61a3-49fd-b426-00cba4f16831 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36922025-01-09T01:06:16.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff284979-61a3-49fd-b426-00cba4f16831 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36932025-01-09T01:06:16.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff284979-61a3-49fd-b426-00cba4f16831 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
36942025-01-09T01:06:16.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
36952025-01-09T01:06:16.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36962025-01-09T01:06:16.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
36972025-01-09T01:06:16.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36982025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36992025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37002025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
37012025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
37022025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
37032025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37042025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37052025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37062025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
37072025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
37082025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37092025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37102025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37112025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
37122025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37132025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
37142025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37152025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
37162025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37172025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
37182025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
37192025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37202025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37212025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
37222025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
37232025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37242025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37252025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
37262025-01-09T01:06:16.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37272025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37282025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
37292025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
37302025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37312025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37322025-01-09T01:06:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37332025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37342025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37352025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37362025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37372025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37382025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37392025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37402025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37412025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37422025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37432025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37442025-01-09T01:06:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37452025-01-09T01:06:16.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1220, tv_nsec: 362260264 } })
37462025-01-09T01:06:16.901ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
37472025-01-09T01:06:16.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37482025-01-09T01:06:16.903ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.676243ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37492025-01-09T01:06:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37502025-01-09T01:06:16.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37512025-01-09T01:06:16.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37522025-01-09T01:06:16.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37532025-01-09T01:06:16.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37542025-01-09T01:06:16.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37552025-01-09T01:06:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37562025-01-09T01:06:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37572025-01-09T01:06:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37582025-01-09T01:06:16.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37592025-01-09T01:06:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37602025-01-09T01:06:16.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37612025-01-09T01:06:16.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1220, tv_nsec: 373924787 } })
37622025-01-09T01:06:16.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
37632025-01-09T01:06:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37642025-01-09T01:06:16.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37652025-01-09T01:06:16.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37662025-01-09T01:06:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37672025-01-09T01:06:16.915ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37682025-01-09T01:06:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37692025-01-09T01:06:16.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37702025-01-09T01:06:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37712025-01-09T01:06:16.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37722025-01-09T01:06:16.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37732025-01-09T01:06:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37742025-01-09T01:06:16.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37752025-01-09T01:06:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37762025-01-09T01:06:16.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-01-09T01:06:16.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.092673ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37782025-01-09T01:06:16.920ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1220, tv_nsec: 381156760 } })
37792025-01-09T01:06:16.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
37802025-01-09T01:06:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37812025-01-09T01:06:16.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37822025-01-09T01:06:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37832025-01-09T01:06:16.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37842025-01-09T01:06:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37852025-01-09T01:06:16.941ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37862025-01-09T01:06:16.941ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37872025-01-09T01:06:16.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37882025-01-09T01:06:16.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37892025-01-09T01:06:16.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37902025-01-09T01:06:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37912025-01-09T01:06:16.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37922025-01-09T01:06:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37932025-01-09T01:06:16.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37942025-01-09T01:06:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37952025-01-09T01:06:16.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37962025-01-09T01:06:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37972025-01-09T01:06:16.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37982025-01-09T01:06:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37992025-01-09T01:06:16.953ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38002025-01-09T01:06:16.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.116041ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38012025-01-09T01:06:16.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.634603ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
38022025-01-09T01:06:16.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38032025-01-09T01:06:16.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.470747ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
38042025-01-09T01:06:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38052025-01-09T01:06:16.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38062025-01-09T01:06:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38072025-01-09T01:06:16.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38082025-01-09T01:06:16.962ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38092025-01-09T01:06:16.962ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62b9b27b-aa3a-4a15-b483-2e7b13dd91c7", "content-length": "26", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38102025-01-09T01:06:16.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38112025-01-09T01:06:16.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38122025-01-09T01:06:16.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38132025-01-09T01:06:16.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38142025-01-09T01:06:16.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.0574ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38152025-01-09T01:06:16.982ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38162025-01-09T01:06:16.982ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38172025-01-09T01:06:16.982ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38182025-01-09T01:06:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38192025-01-09T01:06:16.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38202025-01-09T01:06:16.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38212025-01-09T01:06:16.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38222025-01-09T01:06:16.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38232025-01-09T01:06:16.990ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38242025-01-09T01:06:16.990ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38252025-01-09T01:06:16.990ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c197e1c-26f2-4f0c-81dd-ff4046fa2366", "content-length": "26", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38262025-01-09T01:06:16.990ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38272025-01-09T01:06:16.992ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38282025-01-09T01:06:16.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38292025-01-09T01:06:16.994ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38302025-01-09T01:06:16.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38312025-01-09T01:06:16.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
38322025-01-09T01:06:16.995ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38332025-01-09T01:06:16.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38342025-01-09T01:06:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.325186ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38352025-01-09T01:06:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.732356ms iteration = 6 status = 0
38362025-01-09T01:06:17.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38372025-01-09T01:06:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
38382025-01-09T01:06:17.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38392025-01-09T01:06:17.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38402025-01-09T01:06:17.013ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
38412025-01-09T01:06:17.013ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38422025-01-09T01:06:17.013ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f05e1e-2694-49c1-b2a7-29d75dbd8070", "content-length": "26", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38432025-01-09T01:06:17.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38442025-01-09T01:06:17.014ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38452025-01-09T01:06:17.014ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38462025-01-09T01:06:17.014ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.470812ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38472025-01-09T01:06:17.014ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
38482025-01-09T01:06:17.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38492025-01-09T01:06:17.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38502025-01-09T01:06:17.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38512025-01-09T01:06:17.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38522025-01-09T01:06:17.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38532025-01-09T01:06:17.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38542025-01-09T01:06:17.062ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38552025-01-09T01:06:17.062ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fad0e7e4-aa00-4b47-b46e-a5f88e22f612", "content-length": "1", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38562025-01-09T01:06:17.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38572025-01-09T01:06:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38582025-01-09T01:06:17.091ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 192.633636ms iteration = 6 status = {}
38592025-01-09T01:06:17.092ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38602025-01-09T01:06:17.092ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38612025-01-09T01:06:17.092ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c65bd728-f262-43da-81ff-6ba6c2e1bf73", "content-length": "372", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38622025-01-09T01:06:17.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38632025-01-09T01:06:17.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38642025-01-09T01:06:17.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652025-01-09T01:06:17.094ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.858519ms iteration = 6 status = null
38662025-01-09T01:06:17.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38672025-01-09T01:06:17.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38682025-01-09T01:06:17.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38692025-01-09T01:06:17.105ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38702025-01-09T01:06:17.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38712025-01-09T01:06:17.112ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
38722025-01-09T01:06:17.112ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 212.831302ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
38732025-01-09T01:06:17.133ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 234.298666ms iteration = 8 status = {"physical_disks_added":0}
38742025-01-09T01:06:17.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 237.605891ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38752025-01-09T01:06:17.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38762025-01-09T01:06:17.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38772025-01-09T01:06:17.162ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
38782025-01-09T01:06:17.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38792025-01-09T01:06:17.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38802025-01-09T01:06:17.168ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38812025-01-09T01:06:17.168ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "88aa1f45-903f-4901-9302-d726c65d0c9b", "content-length": "134", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38822025-01-09T01:06:17.168ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38832025-01-09T01:06:17.168ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
38842025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38852025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38862025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38872025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38882025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38892025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38902025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38912025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38922025-01-09T01:06:17.169ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
38932025-01-09T01:06:17.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38942025-01-09T01:06:17.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38952025-01-09T01:06:17.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38962025-01-09T01:06:17.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c08f99be-d785-41f3-93f1-8b88aaf0d76b", "content-length": "2", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38972025-01-09T01:06:17.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38982025-01-09T01:06:17.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78ac73e5-d920-431f-8ac7-52f7671339c6", "content-length": "52", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
38992025-01-09T01:06:17.171ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
39002025-01-09T01:06:17.171ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39012025-01-09T01:06:17.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39022025-01-09T01:06:17.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2d7a7e83-39f6-4faf-b0ca-9bb43928d71f", "date": "Thu, 09 Jan 2025 01:06:17 GMT"} })
39032025-01-09T01:06:17.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39042025-01-09T01:06:17.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39052025-01-09T01:06:17.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4297a103-0405-4ef7-b8ab-55e81553295e", "content-length": "691", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
39062025-01-09T01:06:17.199ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
39072025-01-09T01:06:17.200ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39082025-01-09T01:06:17.200ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39092025-01-09T01:06:17.200ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.611343ms iteration = 6 status = {}
39102025-01-09T01:06:17.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39112025-01-09T01:06:17.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39122025-01-09T01:06:17.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39132025-01-09T01:06:17.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39142025-01-09T01:06:17.209ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39152025-01-09T01:06:17.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39162025-01-09T01:06:17.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "44172c20-0f0b-4a33-9522-518d6b0683ea", "date": "Thu, 09 Jan 2025 01:06:17 GMT"} })
39172025-01-09T01:06:17.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 312.085231ms iteration = 6 status = {}
39182025-01-09T01:06:17.384ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dbf82587-b760-4ee6-824c-cd121fb7d46c", "date": "Thu, 09 Jan 2025 01:06:17 GMT"} })
39192025-01-09T01:06:17.384ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
39202025-01-09T01:06:17.384ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39212025-01-09T01:06:17.384ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5b37191-e438-4551-86a8-f2457c5574ad", "content-length": "682", "date": "Thu, 09 Jan 2025 01:06:16 GMT"} })
39222025-01-09T01:06:17.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39232025-01-09T01:06:17.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39242025-01-09T01:06:17.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39252025-01-09T01:06:17.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39262025-01-09T01:06:17.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39272025-01-09T01:06:17.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39282025-01-09T01:06:17.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39292025-01-09T01:06:17.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39302025-01-09T01:06:17.476ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 577.07416ms iteration = 6 status = {}
39312025-01-09T01:06:17.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 31209cea-8034-4068-be60-5ed4a99c56b6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39322025-01-09T01:06:17.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 31209cea-8034-4068-be60-5ed4a99c56b6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39332025-01-09T01:06:17.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 31209cea-8034-4068-be60-5ed4a99c56b6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39342025-01-09T01:06:18.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6f77a3f-a296-4eba-871e-c511ce79a8c2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39352025-01-09T01:06:18.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6f77a3f-a296-4eba-871e-c511ce79a8c2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39362025-01-09T01:06:18.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6f77a3f-a296-4eba-871e-c511ce79a8c2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39372025-01-09T01:06:19.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d2eb75b-7495-4422-82e4-7d325abeba07 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39382025-01-09T01:06:19.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d2eb75b-7495-4422-82e4-7d325abeba07 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39392025-01-09T01:06:19.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d2eb75b-7495-4422-82e4-7d325abeba07 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39402025-01-09T01:06:19.940ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 50a7c5e0-3332-4084-af4b-81781ace0a1e response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
39412025-01-09T01:06:20.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 417920d8-25e6-4a29-8969-abc1a8dccb3a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39422025-01-09T01:06:20.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 417920d8-25e6-4a29-8969-abc1a8dccb3a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39432025-01-09T01:06:20.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 417920d8-25e6-4a29-8969-abc1a8dccb3a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39442025-01-09T01:06:21.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ebd7069c-4201-450c-82a3-f26589ac95cd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39452025-01-09T01:06:21.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ebd7069c-4201-450c-82a3-f26589ac95cd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39462025-01-09T01:06:21.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ebd7069c-4201-450c-82a3-f26589ac95cd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39472025-01-09T01:06:22.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5f0592f7-3f75-4dc8-9451-e633f75c4fbd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39482025-01-09T01:06:22.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5f0592f7-3f75-4dc8-9451-e633f75c4fbd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39492025-01-09T01:06:22.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5f0592f7-3f75-4dc8-9451-e633f75c4fbd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39502025-01-09T01:06:23.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c6cb4ed8-2c75-45fc-a7ec-acc423213bc9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39512025-01-09T01:06:23.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c6cb4ed8-2c75-45fc-a7ec-acc423213bc9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39522025-01-09T01:06:23.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c6cb4ed8-2c75-45fc-a7ec-acc423213bc9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39532025-01-09T01:06:25.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 768080cd-9302-4a82-8b5c-efe2ce93e994 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39542025-01-09T01:06:25.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 768080cd-9302-4a82-8b5c-efe2ce93e994 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39552025-01-09T01:06:25.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 768080cd-9302-4a82-8b5c-efe2ce93e994 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39562025-01-09T01:06:26.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2b7e3735-b4b5-4021-a71f-c83d5be3666b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39572025-01-09T01:06:26.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2b7e3735-b4b5-4021-a71f-c83d5be3666b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39582025-01-09T01:06:26.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2b7e3735-b4b5-4021-a71f-c83d5be3666b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39592025-01-09T01:06:26.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
39602025-01-09T01:06:26.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
39612025-01-09T01:06:26.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39622025-01-09T01:06:26.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39632025-01-09T01:06:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39642025-01-09T01:06:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39652025-01-09T01:06:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39662025-01-09T01:06:26.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39672025-01-09T01:06:26.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39682025-01-09T01:06:26.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.303857ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39692025-01-09T01:06:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39702025-01-09T01:06:26.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39712025-01-09T01:06:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39722025-01-09T01:06:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39732025-01-09T01:06:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39742025-01-09T01:06:26.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39752025-01-09T01:06:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
39762025-01-09T01:06:26.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39772025-01-09T01:06:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39782025-01-09T01:06:26.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
39792025-01-09T01:06:26.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.800327ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
39802025-01-09T01:06:27.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ed5aae06-1fab-4f09-803e-b084aef89e0a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39812025-01-09T01:06:27.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ed5aae06-1fab-4f09-803e-b084aef89e0a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39822025-01-09T01:06:27.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ed5aae06-1fab-4f09-803e-b084aef89e0a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39832025-01-09T01:06:28.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5307719d-6cf7-4229-83dc-d5bef2403c51 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39842025-01-09T01:06:28.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5307719d-6cf7-4229-83dc-d5bef2403c51 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39852025-01-09T01:06:28.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5307719d-6cf7-4229-83dc-d5bef2403c51 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39862025-01-09T01:06:29.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1238c2d7-8201-4c3b-a7b5-53ac24b24a22 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39872025-01-09T01:06:29.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1238c2d7-8201-4c3b-a7b5-53ac24b24a22 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39882025-01-09T01:06:29.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1238c2d7-8201-4c3b-a7b5-53ac24b24a22 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39892025-01-09T01:06:29.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 2b6b411b-d5a7-48ca-ab69-bcdb2878176b response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
39902025-01-09T01:06:30.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a809b281-c84b-4fe4-ab30-3ea072b96d72 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39912025-01-09T01:06:30.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a809b281-c84b-4fe4-ab30-3ea072b96d72 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39922025-01-09T01:06:30.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a809b281-c84b-4fe4-ab30-3ea072b96d72 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39932025-01-09T01:06:31.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2eb4ef4b-7b37-4b1e-a1be-6099b7d3a5a2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39942025-01-09T01:06:31.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2eb4ef4b-7b37-4b1e-a1be-6099b7d3a5a2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39952025-01-09T01:06:31.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2eb4ef4b-7b37-4b1e-a1be-6099b7d3a5a2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39962025-01-09T01:06:32.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 440f13f5-eb1e-416c-a80f-6df62fc00232 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39972025-01-09T01:06:32.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 440f13f5-eb1e-416c-a80f-6df62fc00232 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39982025-01-09T01:06:32.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 440f13f5-eb1e-416c-a80f-6df62fc00232 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
39992025-01-09T01:06:33.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c2233d1-6920-4281-8887-539a32b6e577 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40002025-01-09T01:06:33.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c2233d1-6920-4281-8887-539a32b6e577 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40012025-01-09T01:06:33.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c2233d1-6920-4281-8887-539a32b6e577 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40022025-01-09T01:06:34.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 69913743-b138-4a17-816f-76bc72c24216 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40032025-01-09T01:06:34.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 69913743-b138-4a17-816f-76bc72c24216 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40042025-01-09T01:06:34.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 69913743-b138-4a17-816f-76bc72c24216 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40052025-01-09T01:06:35.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 436f4c83-3f05-4590-9b7d-808a0f3c20b1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40062025-01-09T01:06:35.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 436f4c83-3f05-4590-9b7d-808a0f3c20b1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40072025-01-09T01:06:35.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 436f4c83-3f05-4590-9b7d-808a0f3c20b1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40082025-01-09T01:06:36.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1b447fbc-c140-4956-9e47-03677c480acf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40092025-01-09T01:06:36.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1b447fbc-c140-4956-9e47-03677c480acf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40102025-01-09T01:06:36.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1b447fbc-c140-4956-9e47-03677c480acf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40112025-01-09T01:06:36.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
40122025-01-09T01:06:36.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
40132025-01-09T01:06:36.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40142025-01-09T01:06:36.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40152025-01-09T01:06:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40162025-01-09T01:06:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40172025-01-09T01:06:36.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40182025-01-09T01:06:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40192025-01-09T01:06:36.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202025-01-09T01:06:36.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.120803ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40212025-01-09T01:06:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40222025-01-09T01:06:36.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40232025-01-09T01:06:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40242025-01-09T01:06:36.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40252025-01-09T01:06:36.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40262025-01-09T01:06:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40272025-01-09T01:06:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
40282025-01-09T01:06:36.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40292025-01-09T01:06:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40302025-01-09T01:06:37.022ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
40312025-01-09T01:06:37.022ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.904493ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
40322025-01-09T01:06:37.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a1cf758-6b98-4178-a660-235ee0236715 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40332025-01-09T01:06:37.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a1cf758-6b98-4178-a660-235ee0236715 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40342025-01-09T01:06:37.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a1cf758-6b98-4178-a660-235ee0236715 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40352025-01-09T01:06:38.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcd1e29b-887e-425e-a6e8-75c9cdc1a552 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40362025-01-09T01:06:38.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcd1e29b-887e-425e-a6e8-75c9cdc1a552 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40372025-01-09T01:06:38.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcd1e29b-887e-425e-a6e8-75c9cdc1a552 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40382025-01-09T01:06:39.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ceca1089-bb3f-494a-878d-cdf83ab58d73 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40392025-01-09T01:06:39.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ceca1089-bb3f-494a-878d-cdf83ab58d73 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40402025-01-09T01:06:39.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ceca1089-bb3f-494a-878d-cdf83ab58d73 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40412025-01-09T01:06:39.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 5dccfb63-9970-47a5-aed8-e59455fdfe48 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
40422025-01-09T01:06:40.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 831e723a-8b44-415c-a938-c3150a22e0bc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40432025-01-09T01:06:40.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 831e723a-8b44-415c-a938-c3150a22e0bc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40442025-01-09T01:06:40.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 831e723a-8b44-415c-a938-c3150a22e0bc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40452025-01-09T01:06:41.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9593d5f9-5cb2-48ca-bb4e-be75a0d1fdb9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40462025-01-09T01:06:41.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9593d5f9-5cb2-48ca-bb4e-be75a0d1fdb9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40472025-01-09T01:06:41.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9593d5f9-5cb2-48ca-bb4e-be75a0d1fdb9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40482025-01-09T01:06:42.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = df15885a-4d1a-4896-bb71-4cd6bf58bc56 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40492025-01-09T01:06:42.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = df15885a-4d1a-4896-bb71-4cd6bf58bc56 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40502025-01-09T01:06:42.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = df15885a-4d1a-4896-bb71-4cd6bf58bc56 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40512025-01-09T01:06:43.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4bcb5aa-daf7-4e81-96ec-70dec4511555 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40522025-01-09T01:06:43.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4bcb5aa-daf7-4e81-96ec-70dec4511555 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40532025-01-09T01:06:43.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4bcb5aa-daf7-4e81-96ec-70dec4511555 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40542025-01-09T01:06:44.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = de9bdd38-3acb-42c4-9ac8-7a46037c174a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40552025-01-09T01:06:44.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = de9bdd38-3acb-42c4-9ac8-7a46037c174a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40562025-01-09T01:06:44.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = de9bdd38-3acb-42c4-9ac8-7a46037c174a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40572025-01-09T01:06:45.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5ad4e6c-a627-4e8c-b854-0b5f5999f4cd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40582025-01-09T01:06:45.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5ad4e6c-a627-4e8c-b854-0b5f5999f4cd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40592025-01-09T01:06:45.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5ad4e6c-a627-4e8c-b854-0b5f5999f4cd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40602025-01-09T01:06:46.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7fb600a0-9a36-4a55-b0e8-69f2a426888d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40612025-01-09T01:06:46.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7fb600a0-9a36-4a55-b0e8-69f2a426888d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40622025-01-09T01:06:46.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7fb600a0-9a36-4a55-b0e8-69f2a426888d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
40632025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
40642025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
40652025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40662025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40672025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
40682025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40692025-01-09T01:06:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:56:46.899177653 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40702025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40712025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
40722025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40732025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
40742025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
40752025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
40762025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40772025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40782025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
40792025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40802025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
40812025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
40822025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40832025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40842025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40852025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40862025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40872025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40882025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40892025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40902025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
40912025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
40922025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40932025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
40942025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40952025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
40962025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40972025-01-09T01:06:46.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40982025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40992025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
41002025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41012025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
41022025-01-09T01:06:46.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
41032025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.35\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
41042025-01-09T01:06:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
41052025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41062025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
41072025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
41082025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41092025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41102025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
41112025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
41122025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41132025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41142025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
41152025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41162025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
41172025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
41182025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41192025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
41202025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41212025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
41222025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41232025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41242025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
41252025-01-09T01:06:46.900ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41262025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
41272025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41282025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
41292025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41302025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41312025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
41322025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41332025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41342025-01-09T01:06:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 360611400 } })
41352025-01-09T01:06:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 360630740 } })
41362025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41372025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41382025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41392025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41402025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41412025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41422025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41432025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41442025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41452025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41462025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41472025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41482025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41492025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41502025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41512025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41522025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41532025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41542025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41552025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41562025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41572025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41582025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41592025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41602025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.547485ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41612025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
41622025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41632025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41642025-01-09T01:06:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.588066ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
41652025-01-09T01:06:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41662025-01-09T01:06:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41672025-01-09T01:06:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41682025-01-09T01:06:46.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41692025-01-09T01:06:46.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 363405843 } })
41702025-01-09T01:06:46.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
41712025-01-09T01:06:46.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41722025-01-09T01:06:46.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 364413536 } })
41732025-01-09T01:06:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41742025-01-09T01:06:46.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41752025-01-09T01:06:46.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41762025-01-09T01:06:46.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
41772025-01-09T01:06:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41782025-01-09T01:06:46.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:56:46.899177653 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41792025-01-09T01:06:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.890223ms iteration = 4 status = {"expiration":"2025-01-09T00:56:46.899177653Z","pruned":[]}
41802025-01-09T01:06:46.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812025-01-09T01:06:46.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41822025-01-09T01:06:46.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41832025-01-09T01:06:46.907ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.831017ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41842025-01-09T01:06:46.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41852025-01-09T01:06:46.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41862025-01-09T01:06:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41872025-01-09T01:06:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41882025-01-09T01:06:46.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41892025-01-09T01:06:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41902025-01-09T01:06:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41912025-01-09T01:06:46.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41922025-01-09T01:06:46.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932025-01-09T01:06:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41942025-01-09T01:06:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41952025-01-09T01:06:46.914ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41962025-01-09T01:06:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41972025-01-09T01:06:46.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41982025-01-09T01:06:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41992025-01-09T01:06:46.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42002025-01-09T01:06:46.918ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.201701ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
42012025-01-09T01:06:46.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42022025-01-09T01:06:46.918ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42032025-01-09T01:06:46.918ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42042025-01-09T01:06:46.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42052025-01-09T01:06:46.919ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42062025-01-09T01:06:46.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42072025-01-09T01:06:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42082025-01-09T01:06:46.921ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42092025-01-09T01:06:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42102025-01-09T01:06:46.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42112025-01-09T01:06:46.922ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42122025-01-09T01:06:46.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42132025-01-09T01:06:46.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42142025-01-09T01:06:46.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42152025-01-09T01:06:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42162025-01-09T01:06:46.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42172025-01-09T01:06:46.925ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182025-01-09T01:06:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42192025-01-09T01:06:46.929ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42202025-01-09T01:06:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42212025-01-09T01:06:46.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42222025-01-09T01:06:46.932ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42232025-01-09T01:06:46.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42242025-01-09T01:06:46.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42252025-01-09T01:06:46.936ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42262025-01-09T01:06:46.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42272025-01-09T01:06:46.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42282025-01-09T01:06:46.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42292025-01-09T01:06:46.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42302025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42312025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42322025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42332025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42342025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42352025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42362025-01-09T01:06:46.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42372025-01-09T01:06:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42382025-01-09T01:06:46.947ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 407674112 } })
42392025-01-09T01:06:46.947ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
42402025-01-09T01:06:46.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42412025-01-09T01:06:46.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42422025-01-09T01:06:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42432025-01-09T01:06:46.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42442025-01-09T01:06:46.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42452025-01-09T01:06:46.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42462025-01-09T01:06:46.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42472025-01-09T01:06:46.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42482025-01-09T01:06:46.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42492025-01-09T01:06:46.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42502025-01-09T01:06:46.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512025-01-09T01:06:46.961ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42522025-01-09T01:06:46.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.844856ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42532025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42542025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42552025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
42562025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42572025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.634628ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
42582025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42592025-01-09T01:06:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42602025-01-09T01:06:46.967ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42612025-01-09T01:06:46.968ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
42622025-01-09T01:06:46.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42632025-01-09T01:06:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42642025-01-09T01:06:46.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42652025-01-09T01:06:46.968ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42662025-01-09T01:06:46.968ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42672025-01-09T01:06:46.968ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.016238ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42682025-01-09T01:06:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42692025-01-09T01:06:46.970ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42702025-01-09T01:06:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42712025-01-09T01:06:46.973ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42722025-01-09T01:06:46.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42732025-01-09T01:06:46.976ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42742025-01-09T01:06:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42752025-01-09T01:06:46.978ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42762025-01-09T01:06:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42772025-01-09T01:06:46.981ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782025-01-09T01:06:46.982ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42792025-01-09T01:06:46.982ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42802025-01-09T01:06:46.982ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42812025-01-09T01:06:46.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42822025-01-09T01:06:46.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.527932ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
42832025-01-09T01:06:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42842025-01-09T01:06:46.983ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42852025-01-09T01:06:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42862025-01-09T01:06:46.983ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42872025-01-09T01:06:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42882025-01-09T01:06:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42892025-01-09T01:06:46.983ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42902025-01-09T01:06:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42912025-01-09T01:06:46.985ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42922025-01-09T01:06:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42932025-01-09T01:06:46.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42942025-01-09T01:06:46.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42952025-01-09T01:06:46.994ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42962025-01-09T01:06:46.994ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42972025-01-09T01:06:46.994ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.485882ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42982025-01-09T01:06:46.995ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42992025-01-09T01:06:46.995ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43002025-01-09T01:06:46.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43012025-01-09T01:06:46.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43022025-01-09T01:06:47.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43032025-01-09T01:06:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43042025-01-09T01:06:47.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43052025-01-09T01:06:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43062025-01-09T01:06:47.055ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43072025-01-09T01:06:47.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 155.426187ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43082025-01-09T01:06:47.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43092025-01-09T01:06:47.079ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43102025-01-09T01:06:47.079ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad6c5ba-2504-4345-a031-4d9be1b3ce11", "content-length": "26", "date": "Thu, 09 Jan 2025 01:06:46 GMT"} })
43112025-01-09T01:06:47.079ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43122025-01-09T01:06:47.081ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43132025-01-09T01:06:47.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43142025-01-09T01:06:47.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
43152025-01-09T01:06:47.265ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43162025-01-09T01:06:47.265ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0247fe0-32fa-49a2-86fe-8553cbd6e6ad", "content-length": "26", "date": "Thu, 09 Jan 2025 01:06:46 GMT"} })
43172025-01-09T01:06:47.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43182025-01-09T01:06:47.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
43192025-01-09T01:06:47.270ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43202025-01-09T01:06:47.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43212025-01-09T01:06:47.284ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43222025-01-09T01:06:47.285ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a842ccf-b134-4025-a3e4-a96093581e55", "content-length": "26", "date": "Thu, 09 Jan 2025 01:06:46 GMT"} })
43232025-01-09T01:06:47.285ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43242025-01-09T01:06:47.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43252025-01-09T01:06:47.288ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.971966ms iteration = 7 status = {}
43262025-01-09T01:06:47.385ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43272025-01-09T01:06:47.385ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43282025-01-09T01:06:47.386ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d5def32-ff2a-4086-a392-d3ed29c7a815", "content-length": "372", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
43292025-01-09T01:06:47.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43302025-01-09T01:06:47.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43312025-01-09T01:06:47.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43322025-01-09T01:06:47.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332025-01-09T01:06:47.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43342025-01-09T01:06:47.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43352025-01-09T01:06:47.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43362025-01-09T01:06:47.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43372025-01-09T01:06:47.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43382025-01-09T01:06:47.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43392025-01-09T01:06:47.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43402025-01-09T01:06:47.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43412025-01-09T01:06:47.394ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 495.08731ms iteration = 3 status = {"nsuccess":5}
43422025-01-09T01:06:47.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43432025-01-09T01:06:47.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43442025-01-09T01:06:47.398ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
43452025-01-09T01:06:47.398ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43462025-01-09T01:06:47.398ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
43472025-01-09T01:06:47.398ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 499.09356ms iteration = 4 status = {"generation":2}
43482025-01-09T01:06:47.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43492025-01-09T01:06:47.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43502025-01-09T01:06:47.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 531.274197ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43512025-01-09T01:06:47.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 533.2054ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43522025-01-09T01:06:47.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532025-01-09T01:06:47.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43542025-01-09T01:06:47.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43552025-01-09T01:06:47.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43562025-01-09T01:06:47.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43572025-01-09T01:06:47.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 540.482244ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43582025-01-09T01:06:47.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43592025-01-09T01:06:47.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43602025-01-09T01:06:47.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43612025-01-09T01:06:47.445ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43622025-01-09T01:06:47.445ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43632025-01-09T01:06:47.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 545.855345ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43642025-01-09T01:06:47.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43652025-01-09T01:06:47.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
43662025-01-09T01:06:47.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43672025-01-09T01:06:47.451ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
43682025-01-09T01:06:47.451ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 552.099457ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43692025-01-09T01:06:47.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702025-01-09T01:06:47.456ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 556.356853ms iteration = 7 status = 0
43712025-01-09T01:06:47.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43722025-01-09T01:06:47.467ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f2aec5e5-5b6e-428e-830c-83a246c2f731", "date": "Thu, 09 Jan 2025 01:06:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43732025-01-09T01:06:47.467ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43742025-01-09T01:06:47.469ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "69e1a958-6338-4ab0-bb26-35847ef48752", "date": "Thu, 09 Jan 2025 01:06:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43752025-01-09T01:06:47.469ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43762025-01-09T01:06:47.469ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43772025-01-09T01:06:47.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 571.031953ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43782025-01-09T01:06:47.471ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43792025-01-09T01:06:47.471ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 572.078367ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43802025-01-09T01:06:47.475ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43812025-01-09T01:06:47.475ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43822025-01-09T01:06:47.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43832025-01-09T01:06:47.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43842025-01-09T01:06:47.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 40934a34-7302-479e-a160-499a94c3b73a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
43852025-01-09T01:06:47.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 40934a34-7302-479e-a160-499a94c3b73a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
43862025-01-09T01:06:47.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 40934a34-7302-479e-a160-499a94c3b73a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
43872025-01-09T01:06:47.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882025-01-09T01:06:47.506ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
43892025-01-09T01:06:47.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 606.81495ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
43902025-01-09T01:06:47.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43912025-01-09T01:06:47.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43922025-01-09T01:06:47.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43932025-01-09T01:06:47.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43942025-01-09T01:06:47.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43952025-01-09T01:06:47.512ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43962025-01-09T01:06:47.512ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43972025-01-09T01:06:47.512ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
43982025-01-09T01:06:47.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 613.159354ms iteration = 4 status = {"generation":1}
43992025-01-09T01:06:47.518ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
44002025-01-09T01:06:47.518ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44012025-01-09T01:06:47.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f665667d-9fbb-413e-b8a3-3bb4b2e68086", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44022025-01-09T01:06:47.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44032025-01-09T01:06:47.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44042025-01-09T01:06:47.530ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44052025-01-09T01:06:47.531ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8870601a-16a4-40c2-9618-c4e55941a82f", "content-length": "1", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44062025-01-09T01:06:47.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44072025-01-09T01:06:47.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44082025-01-09T01:06:47.535ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 636.0423ms iteration = 7 status = null
44092025-01-09T01:06:47.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44102025-01-09T01:06:47.539ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 639.61346ms iteration = 9 status = {"physical_disks_added":0}
44112025-01-09T01:06:47.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44122025-01-09T01:06:47.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44132025-01-09T01:06:47.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44142025-01-09T01:06:47.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44152025-01-09T01:06:47.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44162025-01-09T01:06:47.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44172025-01-09T01:06:47.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44182025-01-09T01:06:47.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44192025-01-09T01:06:47.555ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9ceacfad-8221-4350-9482-5f86af4882ac", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44202025-01-09T01:06:47.555ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44212025-01-09T01:06:47.556ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f52d4149-2b27-457d-b787-81558465a732", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44222025-01-09T01:06:47.556ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44232025-01-09T01:06:47.558ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "201a087f-a642-44a0-b76a-5988f05043fc", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44242025-01-09T01:06:47.558ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44252025-01-09T01:06:47.560ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
44262025-01-09T01:06:47.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 661.3062ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44272025-01-09T01:06:47.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44282025-01-09T01:06:47.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44292025-01-09T01:06:47.571ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
44302025-01-09T01:06:47.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44312025-01-09T01:06:47.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44322025-01-09T01:06:47.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44332025-01-09T01:06:47.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c57d09e-9850-425f-9d10-fb7877b54719", "content-length": "134", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44342025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44352025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
44362025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44372025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44382025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44392025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44402025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44412025-01-09T01:06:47.580ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44422025-01-09T01:06:47.581ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44432025-01-09T01:06:47.581ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44442025-01-09T01:06:47.581ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
44452025-01-09T01:06:47.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44462025-01-09T01:06:47.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44472025-01-09T01:06:47.585ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44482025-01-09T01:06:47.586ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "02e4be9d-be2d-498e-9eae-6240d195a057", "content-length": "2", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44492025-01-09T01:06:47.586ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44502025-01-09T01:06:47.586ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0acba13-aed1-4dfc-80de-e6348d369330", "content-length": "52", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44512025-01-09T01:06:47.586ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
44522025-01-09T01:06:47.586ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44532025-01-09T01:06:47.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44542025-01-09T01:06:47.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44552025-01-09T01:06:47.643ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44562025-01-09T01:06:47.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44572025-01-09T01:06:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44582025-01-09T01:06:47.649ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44592025-01-09T01:06:47.649ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44602025-01-09T01:06:47.690ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6612da3e-d87a-419f-ac12-7cdf33b93e88", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44612025-01-09T01:06:47.690ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
44622025-01-09T01:06:47.690ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44632025-01-09T01:06:47.691ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b35618b-ae63-40fd-8d1b-d6f30a8d8870", "content-length": "682", "date": "Thu, 09 Jan 2025 01:06:46 GMT"} })
44642025-01-09T01:06:47.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44652025-01-09T01:06:47.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44662025-01-09T01:06:47.691ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "34ae54ac-fdc6-4e23-98b0-ed5fa02fb841", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44672025-01-09T01:06:47.691ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "96e3ae4a-1336-48f2-98bf-a878a787f70d", "content-length": "691", "date": "Thu, 09 Jan 2025 01:06:47 GMT"} })
44682025-01-09T01:06:47.691ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44692025-01-09T01:06:47.691ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44702025-01-09T01:06:47.691ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44712025-01-09T01:06:47.692ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 792.810997ms iteration = 7 status = {}
44722025-01-09T01:06:47.693ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 793.189236ms iteration = 7 status = {}
44732025-01-09T01:06:47.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44742025-01-09T01:06:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44752025-01-09T01:06:47.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44762025-01-09T01:06:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44772025-01-09T01:06:47.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44782025-01-09T01:06:47.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44792025-01-09T01:06:47.707ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 807.605211ms iteration = 7 status = {}
44802025-01-09T01:06:48.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 937c182f-c6c8-439c-bb67-c811890d7337 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44812025-01-09T01:06:48.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 937c182f-c6c8-439c-bb67-c811890d7337 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44822025-01-09T01:06:48.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 937c182f-c6c8-439c-bb67-c811890d7337 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44832025-01-09T01:06:49.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce40e48b-6bd2-4fd6-82ad-2fdb2b363f70 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44842025-01-09T01:06:49.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce40e48b-6bd2-4fd6-82ad-2fdb2b363f70 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44852025-01-09T01:06:49.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce40e48b-6bd2-4fd6-82ad-2fdb2b363f70 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44862025-01-09T01:06:49.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 540 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = a30e3004-0b1a-4723-ae1b-af7084b34c2c response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
44872025-01-09T01:06:50.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2bd5348-5ad4-4dcb-a9e1-6c1555472ead roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44882025-01-09T01:06:50.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2bd5348-5ad4-4dcb-a9e1-6c1555472ead resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44892025-01-09T01:06:50.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2bd5348-5ad4-4dcb-a9e1-6c1555472ead response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44902025-01-09T01:06:51.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b969b0e-3d38-4c40-b9d3-ce7d38da7e24 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44912025-01-09T01:06:51.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b969b0e-3d38-4c40-b9d3-ce7d38da7e24 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44922025-01-09T01:06:51.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b969b0e-3d38-4c40-b9d3-ce7d38da7e24 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44932025-01-09T01:06:52.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3faa5cbb-c208-4070-9ce9-9a8a7486a04f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44942025-01-09T01:06:52.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3faa5cbb-c208-4070-9ce9-9a8a7486a04f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44952025-01-09T01:06:52.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3faa5cbb-c208-4070-9ce9-9a8a7486a04f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44962025-01-09T01:06:53.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = acf9dfd8-2464-41b6-80ca-2dcbd8576241 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44972025-01-09T01:06:53.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = acf9dfd8-2464-41b6-80ca-2dcbd8576241 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44982025-01-09T01:06:53.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = acf9dfd8-2464-41b6-80ca-2dcbd8576241 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
44992025-01-09T01:06:54.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2b54f36-cf9b-4cdf-8523-045a1ef33323 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45002025-01-09T01:06:54.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2b54f36-cf9b-4cdf-8523-045a1ef33323 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45012025-01-09T01:06:54.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2b54f36-cf9b-4cdf-8523-045a1ef33323 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45022025-01-09T01:06:55.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27e11c9a-4299-4202-92f3-66a59aec4f81 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45032025-01-09T01:06:55.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27e11c9a-4299-4202-92f3-66a59aec4f81 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45042025-01-09T01:06:55.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27e11c9a-4299-4202-92f3-66a59aec4f81 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45052025-01-09T01:06:56.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ef863dc7-66ab-45c4-bdae-340a4de6beba roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45062025-01-09T01:06:56.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ef863dc7-66ab-45c4-bdae-340a4de6beba resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45072025-01-09T01:06:56.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ef863dc7-66ab-45c4-bdae-340a4de6beba response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45082025-01-09T01:06:56.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
45092025-01-09T01:06:56.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
45102025-01-09T01:06:56.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45112025-01-09T01:06:56.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45122025-01-09T01:06:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45132025-01-09T01:06:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45142025-01-09T01:06:56.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45152025-01-09T01:06:56.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45162025-01-09T01:06:56.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45172025-01-09T01:06:56.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.672183ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45182025-01-09T01:06:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45192025-01-09T01:06:56.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45202025-01-09T01:06:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45212025-01-09T01:06:56.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45222025-01-09T01:06:56.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45232025-01-09T01:06:56.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45242025-01-09T01:06:56.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
45252025-01-09T01:06:56.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45262025-01-09T01:06:56.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45272025-01-09T01:06:56.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
45282025-01-09T01:06:56.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.930529ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
45292025-01-09T01:06:57.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3f96e71e-d5aa-4c8e-926b-97f537bd4eb8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45302025-01-09T01:06:57.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3f96e71e-d5aa-4c8e-926b-97f537bd4eb8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45312025-01-09T01:06:57.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3f96e71e-d5aa-4c8e-926b-97f537bd4eb8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45322025-01-09T01:06:58.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aeeda225-b782-40dd-9902-b7adbcbc1e82 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45332025-01-09T01:06:58.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aeeda225-b782-40dd-9902-b7adbcbc1e82 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45342025-01-09T01:06:58.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aeeda225-b782-40dd-9902-b7adbcbc1e82 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45352025-01-09T01:06:59.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82addd2b-6a38-45b2-8e7a-87d07621c392 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45362025-01-09T01:06:59.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82addd2b-6a38-45b2-8e7a-87d07621c392 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45372025-01-09T01:06:59.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82addd2b-6a38-45b2-8e7a-87d07621c392 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45382025-01-09T01:06:59.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = a9ed04eb-0c3a-4d5c-90c7-7c96088a4ad5 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
45392025-01-09T01:07:00.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca30326e-e68f-4e0e-9d59-e05aa74ea470 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45402025-01-09T01:07:00.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca30326e-e68f-4e0e-9d59-e05aa74ea470 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45412025-01-09T01:07:00.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca30326e-e68f-4e0e-9d59-e05aa74ea470 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45422025-01-09T01:07:01.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b13d4d7e-d1f6-4c81-ab9d-9a166af5db8c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45432025-01-09T01:07:01.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b13d4d7e-d1f6-4c81-ab9d-9a166af5db8c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45442025-01-09T01:07:01.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b13d4d7e-d1f6-4c81-ab9d-9a166af5db8c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45452025-01-09T01:07:02.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7ed88d91-7733-4ebe-987f-7cbe60416bba roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45462025-01-09T01:07:02.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7ed88d91-7733-4ebe-987f-7cbe60416bba resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45472025-01-09T01:07:02.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7ed88d91-7733-4ebe-987f-7cbe60416bba response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45482025-01-09T01:07:03.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ba476af7-cb77-4c41-b703-1668e1d03a1b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45492025-01-09T01:07:03.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ba476af7-cb77-4c41-b703-1668e1d03a1b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45502025-01-09T01:07:03.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ba476af7-cb77-4c41-b703-1668e1d03a1b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45512025-01-09T01:07:04.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5ab15cf4-67a5-4ab2-96eb-3d4c1d8dd877 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45522025-01-09T01:07:04.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5ab15cf4-67a5-4ab2-96eb-3d4c1d8dd877 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45532025-01-09T01:07:04.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5ab15cf4-67a5-4ab2-96eb-3d4c1d8dd877 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45542025-01-09T01:07:05.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27f87d3f-300d-4cc5-889a-54a8b5a9c1cd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45552025-01-09T01:07:05.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27f87d3f-300d-4cc5-889a-54a8b5a9c1cd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45562025-01-09T01:07:05.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27f87d3f-300d-4cc5-889a-54a8b5a9c1cd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45572025-01-09T01:07:06.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
45582025-01-09T01:07:06.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
45592025-01-09T01:07:06.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45602025-01-09T01:07:06.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45612025-01-09T01:07:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45622025-01-09T01:07:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45632025-01-09T01:07:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642025-01-09T01:07:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45652025-01-09T01:07:06.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45662025-01-09T01:07:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45672025-01-09T01:07:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45682025-01-09T01:07:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45692025-01-09T01:07:06.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45702025-01-09T01:07:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
45712025-01-09T01:07:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45722025-01-09T01:07:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45732025-01-09T01:07:06.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
45742025-01-09T01:07:06.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.361752ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
45752025-01-09T01:07:06.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e1f71ee6-1898-48aa-a15a-f933b4829e52 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45762025-01-09T01:07:06.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e1f71ee6-1898-48aa-a15a-f933b4829e52 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45772025-01-09T01:07:06.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e1f71ee6-1898-48aa-a15a-f933b4829e52 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45782025-01-09T01:07:06.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45792025-01-09T01:07:06.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45802025-01-09T01:07:06.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.345912ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45812025-01-09T01:07:07.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8dddbe15-8bbe-4c01-88f0-11b5bf9684bd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45822025-01-09T01:07:07.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8dddbe15-8bbe-4c01-88f0-11b5bf9684bd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45832025-01-09T01:07:07.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8dddbe15-8bbe-4c01-88f0-11b5bf9684bd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45842025-01-09T01:07:08.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee25e25b-2007-4df6-b7ea-cb9cbaae850f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45852025-01-09T01:07:08.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee25e25b-2007-4df6-b7ea-cb9cbaae850f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45862025-01-09T01:07:08.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee25e25b-2007-4df6-b7ea-cb9cbaae850f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45872025-01-09T01:07:09.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 455 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 32d10ef7-7ed0-4fc0-84bb-1b7730b227d3 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
45882025-01-09T01:07:09.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3a03ee8f-27ec-42ad-b616-d6ecfbea695c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45892025-01-09T01:07:09.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3a03ee8f-27ec-42ad-b616-d6ecfbea695c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45902025-01-09T01:07:09.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3a03ee8f-27ec-42ad-b616-d6ecfbea695c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45912025-01-09T01:07:11.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7d410652-915a-47df-b292-96317c2adb0c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45922025-01-09T01:07:11.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7d410652-915a-47df-b292-96317c2adb0c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45932025-01-09T01:07:11.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7d410652-915a-47df-b292-96317c2adb0c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45942025-01-09T01:07:12.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 956a9962-8e91-4fe7-98dc-c90d7075db34 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45952025-01-09T01:07:12.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 956a9962-8e91-4fe7-98dc-c90d7075db34 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45962025-01-09T01:07:12.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 956a9962-8e91-4fe7-98dc-c90d7075db34 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45972025-01-09T01:07:13.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9e6ea315-25da-4d73-9222-a7a506338a33 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45982025-01-09T01:07:13.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9e6ea315-25da-4d73-9222-a7a506338a33 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
45992025-01-09T01:07:13.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9e6ea315-25da-4d73-9222-a7a506338a33 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46002025-01-09T01:07:14.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aa19b3c9-ad22-4b5f-8e15-b0670dbbdb05 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46012025-01-09T01:07:14.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aa19b3c9-ad22-4b5f-8e15-b0670dbbdb05 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46022025-01-09T01:07:14.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aa19b3c9-ad22-4b5f-8e15-b0670dbbdb05 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46032025-01-09T01:07:15.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82040261-5a59-4b9e-bad4-f75b6d23d0d2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46042025-01-09T01:07:15.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82040261-5a59-4b9e-bad4-f75b6d23d0d2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46052025-01-09T01:07:15.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82040261-5a59-4b9e-bad4-f75b6d23d0d2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46062025-01-09T01:07:16.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 89b92eac-a5ed-48ce-9191-a539fb07e70f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46072025-01-09T01:07:16.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 89b92eac-a5ed-48ce-9191-a539fb07e70f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46082025-01-09T01:07:16.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 89b92eac-a5ed-48ce-9191-a539fb07e70f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
46092025-01-09T01:07:16.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
46102025-01-09T01:07:16.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
46112025-01-09T01:07:16.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46122025-01-09T01:07:16.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46132025-01-09T01:07:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46142025-01-09T01:07:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46152025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
46162025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
46172025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46182025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46192025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
46202025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46212025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46222025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
46232025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
46242025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46252025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
46262025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46272025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46282025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
46292025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46302025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
46312025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
46322025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46332025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46342025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
46352025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
46362025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46372025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
46382025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46392025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46402025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
46412025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
46422025-01-09T01:07:16.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46432025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46442025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
46452025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46462025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46472025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46482025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46492025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46502025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46512025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46522025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46532025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46542025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46552025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46562025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46572025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46582025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46592025-01-09T01:07:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46602025-01-09T01:07:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1280, tv_nsec: 362230550 } })
46612025-01-09T01:07:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1280, tv_nsec: 362598758 } })
46622025-01-09T01:07:16.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.532448ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
46632025-01-09T01:07:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
46642025-01-09T01:07:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
46652025-01-09T01:07:16.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46662025-01-09T01:07:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.01658ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46672025-01-09T01:07:16.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46682025-01-09T01:07:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46692025-01-09T01:07:16.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46702025-01-09T01:07:16.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46712025-01-09T01:07:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46722025-01-09T01:07:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46732025-01-09T01:07:16.907ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46742025-01-09T01:07:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46752025-01-09T01:07:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46762025-01-09T01:07:16.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46772025-01-09T01:07:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46782025-01-09T01:07:16.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46792025-01-09T01:07:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46802025-01-09T01:07:16.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46812025-01-09T01:07:16.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822025-01-09T01:07:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46832025-01-09T01:07:16.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46842025-01-09T01:07:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46852025-01-09T01:07:16.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46862025-01-09T01:07:16.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46872025-01-09T01:07:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46882025-01-09T01:07:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46892025-01-09T01:07:16.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46902025-01-09T01:07:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46912025-01-09T01:07:16.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46922025-01-09T01:07:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46932025-01-09T01:07:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46942025-01-09T01:07:16.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.758871ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46952025-01-09T01:07:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.399475ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46962025-01-09T01:07:16.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46972025-01-09T01:07:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46982025-01-09T01:07:16.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46992025-01-09T01:07:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47002025-01-09T01:07:16.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47012025-01-09T01:07:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47022025-01-09T01:07:16.922ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1280, tv_nsec: 382374235 } })
47032025-01-09T01:07:16.922ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
47042025-01-09T01:07:16.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47052025-01-09T01:07:16.924ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47062025-01-09T01:07:16.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.229127ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47072025-01-09T01:07:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47082025-01-09T01:07:16.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47092025-01-09T01:07:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47102025-01-09T01:07:16.940ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47112025-01-09T01:07:16.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47122025-01-09T01:07:16.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47132025-01-09T01:07:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47142025-01-09T01:07:16.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47152025-01-09T01:07:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47162025-01-09T01:07:16.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172025-01-09T01:07:16.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
47182025-01-09T01:07:16.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47192025-01-09T01:07:16.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47202025-01-09T01:07:16.957ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.105668ms iteration = 8 status = 0
47212025-01-09T01:07:16.960ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47222025-01-09T01:07:16.960ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47232025-01-09T01:07:16.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47242025-01-09T01:07:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47252025-01-09T01:07:16.963ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47262025-01-09T01:07:16.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47272025-01-09T01:07:16.965ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47282025-01-09T01:07:16.965ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47292025-01-09T01:07:16.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47302025-01-09T01:07:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47312025-01-09T01:07:16.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47322025-01-09T01:07:16.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332025-01-09T01:07:16.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47342025-01-09T01:07:16.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47352025-01-09T01:07:16.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47362025-01-09T01:07:16.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.660951ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
47372025-01-09T01:07:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
47382025-01-09T01:07:16.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47392025-01-09T01:07:16.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47402025-01-09T01:07:16.981ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47412025-01-09T01:07:16.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47422025-01-09T01:07:16.983ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
47432025-01-09T01:07:16.983ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.89239ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
47442025-01-09T01:07:16.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47452025-01-09T01:07:16.988ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47462025-01-09T01:07:16.988ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e56a9df-7b93-4433-8ad1-19ee00d1afb5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
47472025-01-09T01:07:16.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47482025-01-09T01:07:16.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47492025-01-09T01:07:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.425148ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47502025-01-09T01:07:17.001ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47512025-01-09T01:07:17.001ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47522025-01-09T01:07:17.001ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.731495ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47532025-01-09T01:07:17.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.992235ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47542025-01-09T01:07:17.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47552025-01-09T01:07:17.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47562025-01-09T01:07:17.044ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.638804ms iteration = 10 status = {"physical_disks_added":0}
47572025-01-09T01:07:17.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47582025-01-09T01:07:17.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47592025-01-09T01:07:17.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2429b9a2-6f4e-4d50-a24d-be1d875b3e58", "content-length": "26", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
47602025-01-09T01:07:17.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47612025-01-09T01:07:17.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47622025-01-09T01:07:17.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47632025-01-09T01:07:17.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47642025-01-09T01:07:17.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47652025-01-09T01:07:17.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
47662025-01-09T01:07:17.133ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47672025-01-09T01:07:17.134ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b10cc3a7-691b-4f84-a852-8161ded59262", "content-length": "26", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
47682025-01-09T01:07:17.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47692025-01-09T01:07:17.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47702025-01-09T01:07:17.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47712025-01-09T01:07:17.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47722025-01-09T01:07:17.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
47732025-01-09T01:07:17.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47742025-01-09T01:07:17.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47752025-01-09T01:07:17.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47762025-01-09T01:07:17.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47772025-01-09T01:07:17.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 997a3833-0fe4-4be5-9bd7-8c7534f2b411 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
47782025-01-09T01:07:17.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 997a3833-0fe4-4be5-9bd7-8c7534f2b411 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
47792025-01-09T01:07:17.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 997a3833-0fe4-4be5-9bd7-8c7534f2b411 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
47802025-01-09T01:07:17.196ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47812025-01-09T01:07:17.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47822025-01-09T01:07:17.197ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a1a61e1-b78c-4b0e-8db0-862c1edbaa81", "content-length": "372", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
47832025-01-09T01:07:17.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47842025-01-09T01:07:17.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47852025-01-09T01:07:17.213ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47862025-01-09T01:07:17.214ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c275a8-e02c-4654-8e55-ea00064a3917", "content-length": "1", "date": "Thu, 09 Jan 2025 01:07:17 GMT"} })
47872025-01-09T01:07:17.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47882025-01-09T01:07:17.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47892025-01-09T01:07:17.217ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47902025-01-09T01:07:17.217ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47912025-01-09T01:07:17.217ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76d4b24a-928b-4d25-a5e1-b14ed21932d4", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
47922025-01-09T01:07:17.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47932025-01-09T01:07:17.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47942025-01-09T01:07:17.232ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.116806ms iteration = 8 status = {}
47952025-01-09T01:07:17.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47962025-01-09T01:07:17.256ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f19c3bdf-285a-4501-9047-3bd14b128981", "content-length": "691", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
47972025-01-09T01:07:17.256ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47982025-01-09T01:07:17.256ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47992025-01-09T01:07:17.256ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48002025-01-09T01:07:17.258ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 358.770354ms iteration = 8 status = null
48012025-01-09T01:07:17.258ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 358.12115ms iteration = 8 status = {}
48022025-01-09T01:07:17.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48032025-01-09T01:07:17.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48042025-01-09T01:07:17.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48052025-01-09T01:07:17.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48062025-01-09T01:07:17.264ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48072025-01-09T01:07:17.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48082025-01-09T01:07:17.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b8e2601-9483-4842-b70e-84855643bee8", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
48092025-01-09T01:07:17.267ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 366.748255ms iteration = 8 status = {}
48102025-01-09T01:07:17.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48112025-01-09T01:07:17.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48122025-01-09T01:07:17.302ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
48132025-01-09T01:07:17.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48142025-01-09T01:07:17.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48152025-01-09T01:07:17.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48162025-01-09T01:07:17.313ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "853633aa-f556-4296-874a-6be35bf1dd94", "content-length": "134", "date": "Thu, 09 Jan 2025 01:07:17 GMT"} })
48172025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48182025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
48192025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48202025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48212025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48222025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48232025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48242025-01-09T01:07:17.313ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48252025-01-09T01:07:17.314ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48262025-01-09T01:07:17.314ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48272025-01-09T01:07:17.314ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
48282025-01-09T01:07:17.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48292025-01-09T01:07:17.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48302025-01-09T01:07:17.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48312025-01-09T01:07:17.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c10dabc3-5d5b-4dfe-beaa-92677ec9bd4c", "content-length": "2", "date": "Thu, 09 Jan 2025 01:07:17 GMT"} })
48322025-01-09T01:07:17.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48332025-01-09T01:07:17.317ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "277a2443-b2e7-4736-b3a8-8559b522eb3b", "content-length": "52", "date": "Thu, 09 Jan 2025 01:07:17 GMT"} })
48342025-01-09T01:07:17.317ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
48352025-01-09T01:07:17.317ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48362025-01-09T01:07:17.413ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "47f241c6-c9a5-42b7-ad67-77a4f3c900a2", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
48372025-01-09T01:07:17.413ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
48382025-01-09T01:07:17.413ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48392025-01-09T01:07:17.413ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "be3cfbd4-c390-4491-8235-2c1068a11949", "content-length": "682", "date": "Thu, 09 Jan 2025 01:07:16 GMT"} })
48402025-01-09T01:07:17.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48412025-01-09T01:07:17.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48422025-01-09T01:07:17.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48432025-01-09T01:07:17.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48442025-01-09T01:07:17.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48452025-01-09T01:07:17.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48462025-01-09T01:07:17.422ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48472025-01-09T01:07:17.422ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
48482025-01-09T01:07:17.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48492025-01-09T01:07:17.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48502025-01-09T01:07:17.431ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 531.054522ms iteration = 8 status = {}
48512025-01-09T01:07:17.453ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
48522025-01-09T01:07:17.453ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52130
48532025-01-09T01:07:17.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52130 req_id = 657e06e5-65a6-41f3-810e-89ab7237aba7 roles = RoleSet { roles: {} } uri = /metrics/producers
48542025-01-09T01:07:17.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52130 req_id = 657e06e5-65a6-41f3-810e-89ab7237aba7 resource = Database result = Ok(()) uri = /metrics/producers
48552025-01-09T01:07:17.493ZINFOnexus: assigned collector to new producer collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 file = nexus/src/app/oximeter.rs:76 producer_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
48562025-01-09T01:07:17.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39743 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52130 req_id = 657e06e5-65a6-41f3-810e-89ab7237aba7 response_code = 201 uri = /metrics/producers
48572025-01-09T01:07:17.493ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "657e06e5-65a6-41f3-810e-89ab7237aba7", "content-length": "41", "date": "Thu, 09 Jan 2025 01:07:17 GMT"} })
48582025-01-09T01:07:17.495ZDEBGnexus (producer-registration-task): registered with nexus successfully
48592025-01-09T01:07:17.495ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48602025-01-09T01:07:18.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 621c7f20-56d0-469a-8242-0d38c34445e5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48612025-01-09T01:07:18.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 621c7f20-56d0-469a-8242-0d38c34445e5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48622025-01-09T01:07:18.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 621c7f20-56d0-469a-8242-0d38c34445e5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48632025-01-09T01:07:19.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 396e5f55-fe25-49a4-af17-03f95e7dc862 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48642025-01-09T01:07:19.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 396e5f55-fe25-49a4-af17-03f95e7dc862 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48652025-01-09T01:07:19.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 396e5f55-fe25-49a4-af17-03f95e7dc862 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48662025-01-09T01:07:19.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 509 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = da8ccb36-27b7-4931-a262-bd75d63dbb41 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
48672025-01-09T01:07:20.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6997523d-1501-4f59-a139-93561479c562 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48682025-01-09T01:07:20.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6997523d-1501-4f59-a139-93561479c562 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48692025-01-09T01:07:20.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6997523d-1501-4f59-a139-93561479c562 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48702025-01-09T01:07:21.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 81915ab2-2849-4cf0-945d-22c7a4d2d737 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48712025-01-09T01:07:21.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 81915ab2-2849-4cf0-945d-22c7a4d2d737 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48722025-01-09T01:07:21.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 81915ab2-2849-4cf0-945d-22c7a4d2d737 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48732025-01-09T01:07:22.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aef87f78-80ce-48ba-a492-e4518d93de88 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48742025-01-09T01:07:22.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aef87f78-80ce-48ba-a492-e4518d93de88 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48752025-01-09T01:07:22.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aef87f78-80ce-48ba-a492-e4518d93de88 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48762025-01-09T01:07:23.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dc11bce1-2bb4-4eaf-9fc5-a725b762c689 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48772025-01-09T01:07:23.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dc11bce1-2bb4-4eaf-9fc5-a725b762c689 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48782025-01-09T01:07:23.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dc11bce1-2bb4-4eaf-9fc5-a725b762c689 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48792025-01-09T01:07:24.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff080a55-8cca-4efa-abbf-bbd3a75006be roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48802025-01-09T01:07:24.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff080a55-8cca-4efa-abbf-bbd3a75006be resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48812025-01-09T01:07:24.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff080a55-8cca-4efa-abbf-bbd3a75006be response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48822025-01-09T01:07:25.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4214996-890b-4399-a68c-7370189dde29 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48832025-01-09T01:07:25.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4214996-890b-4399-a68c-7370189dde29 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48842025-01-09T01:07:25.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4214996-890b-4399-a68c-7370189dde29 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48852025-01-09T01:07:26.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eb111c23-3009-4373-8887-fd4d534d1ea5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48862025-01-09T01:07:26.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eb111c23-3009-4373-8887-fd4d534d1ea5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48872025-01-09T01:07:26.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eb111c23-3009-4373-8887-fd4d534d1ea5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
48882025-01-09T01:07:26.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
48892025-01-09T01:07:26.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
48902025-01-09T01:07:26.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48912025-01-09T01:07:26.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48922025-01-09T01:07:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48932025-01-09T01:07:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48942025-01-09T01:07:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48952025-01-09T01:07:26.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48962025-01-09T01:07:26.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48972025-01-09T01:07:26.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.494171ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48982025-01-09T01:07:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48992025-01-09T01:07:26.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49002025-01-09T01:07:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49012025-01-09T01:07:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49022025-01-09T01:07:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49032025-01-09T01:07:26.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49042025-01-09T01:07:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
49052025-01-09T01:07:26.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49062025-01-09T01:07:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49072025-01-09T01:07:26.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
49082025-01-09T01:07:26.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.132854ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
49092025-01-09T01:07:27.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d8fa5c5d-fdb1-4737-902c-574592717522 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49102025-01-09T01:07:27.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d8fa5c5d-fdb1-4737-902c-574592717522 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49112025-01-09T01:07:27.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d8fa5c5d-fdb1-4737-902c-574592717522 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49122025-01-09T01:07:28.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 33c136c2-86ff-465a-b27e-368f3e2d54e8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49132025-01-09T01:07:28.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 33c136c2-86ff-465a-b27e-368f3e2d54e8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49142025-01-09T01:07:28.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 33c136c2-86ff-465a-b27e-368f3e2d54e8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49152025-01-09T01:07:29.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab509267-73e5-481e-a532-b83959e5115a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49162025-01-09T01:07:29.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab509267-73e5-481e-a532-b83959e5115a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49172025-01-09T01:07:29.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab509267-73e5-481e-a532-b83959e5115a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49182025-01-09T01:07:29.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = dc045022-7872-4344-bf70-7f63dbacd249 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
49192025-01-09T01:07:30.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd3a6be3-7515-4bbc-8acd-223d3e3ab36c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49202025-01-09T01:07:30.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd3a6be3-7515-4bbc-8acd-223d3e3ab36c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49212025-01-09T01:07:30.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd3a6be3-7515-4bbc-8acd-223d3e3ab36c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49222025-01-09T01:07:31.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26e9ff3f-3c80-4067-84fe-fa565b7f77ec roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49232025-01-09T01:07:31.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26e9ff3f-3c80-4067-84fe-fa565b7f77ec resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49242025-01-09T01:07:31.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26e9ff3f-3c80-4067-84fe-fa565b7f77ec response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49252025-01-09T01:07:32.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a8bdd40-00a4-4192-91bd-4d09928103ba roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49262025-01-09T01:07:32.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a8bdd40-00a4-4192-91bd-4d09928103ba resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49272025-01-09T01:07:32.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a8bdd40-00a4-4192-91bd-4d09928103ba response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49282025-01-09T01:07:33.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb33954b-04df-4064-a480-1f3a9fc434bb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49292025-01-09T01:07:33.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb33954b-04df-4064-a480-1f3a9fc434bb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49302025-01-09T01:07:33.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb33954b-04df-4064-a480-1f3a9fc434bb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49312025-01-09T01:07:34.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 092640de-862d-4559-8162-b339717ed71a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49322025-01-09T01:07:34.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 092640de-862d-4559-8162-b339717ed71a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49332025-01-09T01:07:34.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 092640de-862d-4559-8162-b339717ed71a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49342025-01-09T01:07:35.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce5a8979-fc25-4c79-90f1-be7d5304c533 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49352025-01-09T01:07:35.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce5a8979-fc25-4c79-90f1-be7d5304c533 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49362025-01-09T01:07:35.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce5a8979-fc25-4c79-90f1-be7d5304c533 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49372025-01-09T01:07:36.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e045454-2628-492b-a432-a2b6a2a4f0d5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49382025-01-09T01:07:36.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e045454-2628-492b-a432-a2b6a2a4f0d5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49392025-01-09T01:07:36.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e045454-2628-492b-a432-a2b6a2a4f0d5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49402025-01-09T01:07:36.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
49412025-01-09T01:07:36.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
49422025-01-09T01:07:36.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49432025-01-09T01:07:36.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49442025-01-09T01:07:36.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49452025-01-09T01:07:36.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49462025-01-09T01:07:36.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49472025-01-09T01:07:36.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49482025-01-09T01:07:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49492025-01-09T01:07:36.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49502025-01-09T01:07:36.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49512025-01-09T01:07:36.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.4439ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49522025-01-09T01:07:36.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49532025-01-09T01:07:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49542025-01-09T01:07:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49552025-01-09T01:07:36.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49562025-01-09T01:07:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
49572025-01-09T01:07:36.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49582025-01-09T01:07:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49592025-01-09T01:07:36.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
49602025-01-09T01:07:36.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.20057ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
49612025-01-09T01:07:37.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8d2a0426-6d92-4811-83b2-6a8469a682e8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49622025-01-09T01:07:37.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8d2a0426-6d92-4811-83b2-6a8469a682e8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49632025-01-09T01:07:37.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8d2a0426-6d92-4811-83b2-6a8469a682e8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49642025-01-09T01:07:38.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9503675c-f3f0-4ad2-8588-a69fe777bc62 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49652025-01-09T01:07:38.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9503675c-f3f0-4ad2-8588-a69fe777bc62 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49662025-01-09T01:07:38.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9503675c-f3f0-4ad2-8588-a69fe777bc62 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49672025-01-09T01:07:39.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86bb2307-92ad-4683-94b6-4a51c3320785 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49682025-01-09T01:07:39.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86bb2307-92ad-4683-94b6-4a51c3320785 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49692025-01-09T01:07:39.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86bb2307-92ad-4683-94b6-4a51c3320785 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49702025-01-09T01:07:39.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 4fa2c6c8-5d36-44ac-8490-bdb2ae524e95 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
49712025-01-09T01:07:40.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e239c843-f7fb-46bc-a88c-f103271b00ed roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49722025-01-09T01:07:40.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e239c843-f7fb-46bc-a88c-f103271b00ed resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49732025-01-09T01:07:40.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e239c843-f7fb-46bc-a88c-f103271b00ed response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49742025-01-09T01:07:41.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cbe57287-9a88-45b1-95d3-2560260a21e3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49752025-01-09T01:07:41.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cbe57287-9a88-45b1-95d3-2560260a21e3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49762025-01-09T01:07:41.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cbe57287-9a88-45b1-95d3-2560260a21e3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49772025-01-09T01:07:42.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b88816c6-145e-4ad4-adc7-3b1626f5b672 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49782025-01-09T01:07:42.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b88816c6-145e-4ad4-adc7-3b1626f5b672 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49792025-01-09T01:07:42.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b88816c6-145e-4ad4-adc7-3b1626f5b672 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49802025-01-09T01:07:43.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 493a6546-e27a-4b32-a834-4e4906e78a6a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49812025-01-09T01:07:43.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 493a6546-e27a-4b32-a834-4e4906e78a6a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49822025-01-09T01:07:43.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 493a6546-e27a-4b32-a834-4e4906e78a6a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49832025-01-09T01:07:44.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2fee933-bcbc-4515-b2a0-38e638677685 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49842025-01-09T01:07:44.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2fee933-bcbc-4515-b2a0-38e638677685 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49852025-01-09T01:07:44.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2fee933-bcbc-4515-b2a0-38e638677685 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49862025-01-09T01:07:44.933ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:40307
49872025-01-09T01:07:44.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = f90a4d52-b7e3-4a89-8c68-605d92f4bff6 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
49882025-01-09T01:07:44.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = f90a4d52-b7e3-4a89-8c68-605d92f4bff6 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
49892025-01-09T01:07:44.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = f90a4d52-b7e3-4a89-8c68-605d92f4bff6 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
49902025-01-09T01:07:44.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = a0ddd982-df8d-4cd5-a4a7-4634a89fe7ca roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
49912025-01-09T01:07:44.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = a0ddd982-df8d-4cd5-a4a7-4634a89fe7ca resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
49922025-01-09T01:07:44.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = a0ddd982-df8d-4cd5-a4a7-4634a89fe7ca response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
49932025-01-09T01:07:45.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4031732b-6b63-43fe-849d-0ac9f6e55949 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49942025-01-09T01:07:45.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4031732b-6b63-43fe-849d-0ac9f6e55949 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49952025-01-09T01:07:45.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4031732b-6b63-43fe-849d-0ac9f6e55949 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49962025-01-09T01:07:46.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0554e5a8-e412-4cd9-aab2-734e44d7db49 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49972025-01-09T01:07:46.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0554e5a8-e412-4cd9-aab2-734e44d7db49 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49982025-01-09T01:07:46.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0554e5a8-e412-4cd9-aab2-734e44d7db49 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
49992025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
50002025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50012025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50022025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
50032025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50042025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
50052025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
50062025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50072025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50082025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
50092025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
50102025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
50112025-01-09T01:07:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:57:46.899298939 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50122025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50132025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
50142025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
50152025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50162025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
50172025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50182025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
50192025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50202025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
50212025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
50222025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50232025-01-09T01:07:46.899ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50242025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50252025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
50262025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50272025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
50282025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50292025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
50302025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50312025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50322025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
50332025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
50342025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
50352025-01-09T01:07:46.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50362025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50372025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
50382025-01-09T01:07:46.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
50392025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50402025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50412025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.18\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
50422025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
50432025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
50442025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50452025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50462025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
50472025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
50482025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50492025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50502025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
50512025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
50522025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50532025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
50542025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
50552025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50562025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50572025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
50582025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50592025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
50602025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50612025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50622025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50632025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50642025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50652025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50662025-01-09T01:07:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50672025-01-09T01:07:46.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 360726026 } })
50682025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50692025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50702025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50712025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50722025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50732025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50742025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50752025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50762025-01-09T01:07:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 360901680 } })
50772025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50782025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50792025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50802025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50812025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50822025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50832025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50842025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50852025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50862025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50872025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50882025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
50892025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.3331ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50902025-01-09T01:07:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.388571ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
50912025-01-09T01:07:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50922025-01-09T01:07:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50932025-01-09T01:07:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50942025-01-09T01:07:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50952025-01-09T01:07:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.190142ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50962025-01-09T01:07:46.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 363579201 } })
50972025-01-09T01:07:46.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50982025-01-09T01:07:46.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50992025-01-09T01:07:46.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 365472664 } })
51002025-01-09T01:07:46.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51012025-01-09T01:07:46.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:57:46.899298939 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51022025-01-09T01:07:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.095667ms iteration = 5 status = {"expiration":"2025-01-09T00:57:46.899298939Z","pruned":[]}
51032025-01-09T01:07:46.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51042025-01-09T01:07:46.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51052025-01-09T01:07:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51062025-01-09T01:07:46.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51072025-01-09T01:07:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51082025-01-09T01:07:46.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.525825ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
51092025-01-09T01:07:46.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.568585ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
51102025-01-09T01:07:46.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51112025-01-09T01:07:46.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51122025-01-09T01:07:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51132025-01-09T01:07:46.916ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51142025-01-09T01:07:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51152025-01-09T01:07:46.917ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.205851ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
51162025-01-09T01:07:46.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51172025-01-09T01:07:46.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51182025-01-09T01:07:46.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51192025-01-09T01:07:46.925ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51202025-01-09T01:07:46.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51212025-01-09T01:07:46.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51222025-01-09T01:07:46.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232025-01-09T01:07:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51242025-01-09T01:07:46.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51252025-01-09T01:07:46.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51262025-01-09T01:07:46.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51272025-01-09T01:07:46.957ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51282025-01-09T01:07:46.958ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51292025-01-09T01:07:46.958ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51302025-01-09T01:07:46.958ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.41244ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51312025-01-09T01:07:46.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51322025-01-09T01:07:46.961ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51332025-01-09T01:07:46.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51342025-01-09T01:07:46.965ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51352025-01-09T01:07:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51362025-01-09T01:07:46.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.985396ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51372025-01-09T01:07:46.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382025-01-09T01:07:46.969ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51392025-01-09T01:07:46.969ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51402025-01-09T01:07:46.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51412025-01-09T01:07:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51422025-01-09T01:07:46.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51432025-01-09T01:07:46.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51442025-01-09T01:07:46.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51452025-01-09T01:07:46.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51462025-01-09T01:07:46.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51472025-01-09T01:07:46.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51482025-01-09T01:07:46.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492025-01-09T01:07:46.976ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51502025-01-09T01:07:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51512025-01-09T01:07:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51522025-01-09T01:07:46.977ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51532025-01-09T01:07:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51542025-01-09T01:07:46.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51552025-01-09T01:07:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51562025-01-09T01:07:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51572025-01-09T01:07:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51582025-01-09T01:07:46.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51592025-01-09T01:07:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51602025-01-09T01:07:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51612025-01-09T01:07:46.980ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51622025-01-09T01:07:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51632025-01-09T01:07:46.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51642025-01-09T01:07:46.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.659863ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51652025-01-09T01:07:46.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51662025-01-09T01:07:46.982ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51672025-01-09T01:07:46.982ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51682025-01-09T01:07:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51692025-01-09T01:07:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51702025-01-09T01:07:46.983ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 444093717 } })
51712025-01-09T01:07:46.983ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
51722025-01-09T01:07:46.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51732025-01-09T01:07:46.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51742025-01-09T01:07:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51752025-01-09T01:07:46.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51762025-01-09T01:07:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51772025-01-09T01:07:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51782025-01-09T01:07:46.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51792025-01-09T01:07:46.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51802025-01-09T01:07:46.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51812025-01-09T01:07:46.991ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51822025-01-09T01:07:46.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51832025-01-09T01:07:46.992ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51842025-01-09T01:07:46.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.044509ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51852025-01-09T01:07:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
51862025-01-09T01:07:46.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51872025-01-09T01:07:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51882025-01-09T01:07:47.001ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.969501ms iteration = 11 status = {"physical_disks_added":0}
51892025-01-09T01:07:47.006ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51902025-01-09T01:07:47.006ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51912025-01-09T01:07:47.006ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.584405ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51922025-01-09T01:07:47.018ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
51932025-01-09T01:07:47.019ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
51942025-01-09T01:07:47.019ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
51952025-01-09T01:07:47.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51962025-01-09T01:07:47.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51972025-01-09T01:07:47.020ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51982025-01-09T01:07:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51992025-01-09T01:07:47.021ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
52002025-01-09T01:07:47.021ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.898821ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
52012025-01-09T01:07:47.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52022025-01-09T01:07:47.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52032025-01-09T01:07:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52042025-01-09T01:07:47.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52052025-01-09T01:07:47.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52062025-01-09T01:07:47.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52072025-01-09T01:07:47.028ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52082025-01-09T01:07:47.028ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52092025-01-09T01:07:47.028ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52102025-01-09T01:07:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52112025-01-09T01:07:47.029ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.894591ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52122025-01-09T01:07:47.029ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.272989ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52132025-01-09T01:07:47.036ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52142025-01-09T01:07:47.041ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52152025-01-09T01:07:47.041ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52162025-01-09T01:07:47.041ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "600720a2-7092-4d7d-86c9-30338d5d93c4", "content-length": "26", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} })
52172025-01-09T01:07:47.041ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52182025-01-09T01:07:47.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52192025-01-09T01:07:47.044ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52202025-01-09T01:07:47.044ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52212025-01-09T01:07:47.044ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c3c7ea3-01fd-4c95-83b6-c3706d6ea0fe", "content-length": "26", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} })
52222025-01-09T01:07:47.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52232025-01-09T01:07:47.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52242025-01-09T01:07:47.050ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52252025-01-09T01:07:47.050ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52262025-01-09T01:07:47.050ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52272025-01-09T01:07:47.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52282025-01-09T01:07:47.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52292025-01-09T01:07:47.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52302025-01-09T01:07:47.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52312025-01-09T01:07:47.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52322025-01-09T01:07:47.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52332025-01-09T01:07:47.100ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52342025-01-09T01:07:47.185ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52352025-01-09T01:07:47.185ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52362025-01-09T01:07:47.187ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52372025-01-09T01:07:47.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52382025-01-09T01:07:47.189ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52392025-01-09T01:07:47.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52402025-01-09T01:07:47.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412025-01-09T01:07:47.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52422025-01-09T01:07:47.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52432025-01-09T01:07:47.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52442025-01-09T01:07:47.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52452025-01-09T01:07:47.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52462025-01-09T01:07:47.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52472025-01-09T01:07:47.196ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "521b0926-3135-487d-bd96-5c7a126a272f", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52482025-01-09T01:07:47.196ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52492025-01-09T01:07:47.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "82fe332e-0ec3-4b2b-ae15-c1619953140c", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52502025-01-09T01:07:47.198ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52512025-01-09T01:07:47.200ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52522025-01-09T01:07:47.200ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 301.671676ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52532025-01-09T01:07:47.201ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.126607ms iteration = 9 status = {}
52542025-01-09T01:07:47.220ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52552025-01-09T01:07:47.221ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8dd9b05-b33b-4cd8-bc7d-d3bcebdb7f22", "content-length": "1", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
52562025-01-09T01:07:47.222ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52572025-01-09T01:07:47.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52582025-01-09T01:07:47.224ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52592025-01-09T01:07:47.224ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52602025-01-09T01:07:47.224ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 324.804098ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52612025-01-09T01:07:47.225ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 326.397524ms iteration = 9 status = null
52622025-01-09T01:07:47.229ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52632025-01-09T01:07:47.229ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52642025-01-09T01:07:47.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52652025-01-09T01:07:47.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52662025-01-09T01:07:47.230ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52672025-01-09T01:07:47.230ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
52682025-01-09T01:07:47.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52692025-01-09T01:07:47.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52702025-01-09T01:07:47.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52712025-01-09T01:07:47.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52722025-01-09T01:07:47.233ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
52732025-01-09T01:07:47.233ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 334.599139ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52742025-01-09T01:07:47.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52752025-01-09T01:07:47.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52762025-01-09T01:07:47.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52772025-01-09T01:07:47.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
52782025-01-09T01:07:47.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52792025-01-09T01:07:47.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52802025-01-09T01:07:47.237ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 338.049997ms iteration = 9 status = 0
52812025-01-09T01:07:47.245ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
52822025-01-09T01:07:47.245ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52832025-01-09T01:07:47.245ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52842025-01-09T01:07:47.245ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52852025-01-09T01:07:47.245ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
52862025-01-09T01:07:47.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 346.033927ms iteration = 5 status = {"generation":1}
52872025-01-09T01:07:47.245ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3082c42-2464-41e4-a65f-cd2e0e84dcf1", "content-length": "26", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} })
52882025-01-09T01:07:47.245ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52892025-01-09T01:07:47.248ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
52902025-01-09T01:07:47.259ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e94ac77-ce1e-4fe4-b961-acf2d39977e0", "content-length": "372", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} })
52912025-01-09T01:07:47.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52922025-01-09T01:07:47.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52932025-01-09T01:07:47.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52942025-01-09T01:07:47.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52952025-01-09T01:07:47.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52962025-01-09T01:07:47.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52972025-01-09T01:07:47.266ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52982025-01-09T01:07:47.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 366.5577ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52992025-01-09T01:07:47.268ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
53002025-01-09T01:07:47.268ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53012025-01-09T01:07:47.268ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
53022025-01-09T01:07:47.268ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 369.349013ms iteration = 5 status = {"generation":2}
53032025-01-09T01:07:47.269ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53042025-01-09T01:07:47.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53052025-01-09T01:07:47.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53062025-01-09T01:07:47.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53072025-01-09T01:07:47.304ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53082025-01-09T01:07:47.304ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53092025-01-09T01:07:47.304ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7f4805b1-4bfc-4518-b6d0-510bf9fbbddf", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} })
53102025-01-09T01:07:47.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53112025-01-09T01:07:47.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53122025-01-09T01:07:47.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53132025-01-09T01:07:47.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53142025-01-09T01:07:47.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53152025-01-09T01:07:47.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162025-01-09T01:07:47.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53172025-01-09T01:07:47.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53182025-01-09T01:07:47.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53192025-01-09T01:07:47.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53202025-01-09T01:07:47.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53212025-01-09T01:07:47.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53222025-01-09T01:07:47.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53232025-01-09T01:07:47.313ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53242025-01-09T01:07:47.313ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53252025-01-09T01:07:47.330ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53262025-01-09T01:07:47.331ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "61e493b4-36f8-4d32-8628-190c2d233c20", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53272025-01-09T01:07:47.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53282025-01-09T01:07:47.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c051b8ae-44a8-480b-8ab6-2ce0319f7310", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53292025-01-09T01:07:47.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53302025-01-09T01:07:47.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c2612df2-3030-42c4-9728-a6b3de7efc16", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53312025-01-09T01:07:47.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53322025-01-09T01:07:47.335ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
53332025-01-09T01:07:47.335ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.143411ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53342025-01-09T01:07:47.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53352025-01-09T01:07:47.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53362025-01-09T01:07:47.404ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
53372025-01-09T01:07:47.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53382025-01-09T01:07:47.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53392025-01-09T01:07:47.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0a4fe25d-bbbc-4d8a-8ffc-a57bb574a182", "date": "Thu, 09 Jan 2025 01:07:46 GMT"} })
53402025-01-09T01:07:47.413ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 513.783102ms iteration = 9 status = {}
53412025-01-09T01:07:47.416ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53422025-01-09T01:07:47.417ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "668666cd-aa47-40ed-80cd-768609929ec9", "content-length": "691", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
53432025-01-09T01:07:47.417ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53442025-01-09T01:07:47.417ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53452025-01-09T01:07:47.417ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53462025-01-09T01:07:47.419ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 519.432379ms iteration = 9 status = {}
53472025-01-09T01:07:47.516ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53482025-01-09T01:07:47.516ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "57d2784b-a960-4db9-898e-20b4ad041e26", "content-length": "134", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
53492025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53502025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
53512025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53522025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53532025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53542025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53552025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53562025-01-09T01:07:47.516ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53572025-01-09T01:07:47.517ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53582025-01-09T01:07:47.517ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53592025-01-09T01:07:47.517ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
53602025-01-09T01:07:47.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53612025-01-09T01:07:47.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53622025-01-09T01:07:47.519ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53632025-01-09T01:07:47.519ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc5f2d70-c755-4625-b79f-1604ec555a59", "content-length": "2", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
53642025-01-09T01:07:47.519ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53652025-01-09T01:07:47.519ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b5d01e9-e086-46cc-bc25-7f83cff2a35e", "content-length": "52", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
53662025-01-09T01:07:47.519ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
53672025-01-09T01:07:47.519ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53682025-01-09T01:07:47.622ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3a67f57e-bc16-44da-b842-503505325706", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
53692025-01-09T01:07:47.622ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
53702025-01-09T01:07:47.622ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53712025-01-09T01:07:47.622ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "430eed29-5ef6-4b18-bbc9-85fdfe4693b0", "content-length": "682", "date": "Thu, 09 Jan 2025 01:07:47 GMT"} })
53722025-01-09T01:07:47.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53732025-01-09T01:07:47.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53742025-01-09T01:07:47.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53752025-01-09T01:07:47.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53762025-01-09T01:07:47.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53772025-01-09T01:07:47.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53782025-01-09T01:07:47.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53792025-01-09T01:07:47.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53802025-01-09T01:07:47.755ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 856.023913ms iteration = 9 status = {}
53812025-01-09T01:07:47.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1513a89a-2619-49ff-a5eb-6210103fc662 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53822025-01-09T01:07:47.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1513a89a-2619-49ff-a5eb-6210103fc662 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53832025-01-09T01:07:47.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1513a89a-2619-49ff-a5eb-6210103fc662 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53842025-01-09T01:07:48.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf6a791a-6060-4e0b-a179-76e300c4b60f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53852025-01-09T01:07:48.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf6a791a-6060-4e0b-a179-76e300c4b60f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53862025-01-09T01:07:48.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf6a791a-6060-4e0b-a179-76e300c4b60f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53872025-01-09T01:07:49.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1300f509-e522-49b4-ac41-1c26a385340a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53882025-01-09T01:07:49.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1300f509-e522-49b4-ac41-1c26a385340a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53892025-01-09T01:07:49.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1300f509-e522-49b4-ac41-1c26a385340a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53902025-01-09T01:07:49.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = e06b1798-9397-4b6b-b75c-619657ada2d0 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
53912025-01-09T01:07:50.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a7203b7-c47f-4b51-9073-8561392da08a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53922025-01-09T01:07:50.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a7203b7-c47f-4b51-9073-8561392da08a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53932025-01-09T01:07:50.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a7203b7-c47f-4b51-9073-8561392da08a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53942025-01-09T01:07:51.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f7459ef3-8030-4fb2-baa1-82ab2408e1e3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53952025-01-09T01:07:51.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f7459ef3-8030-4fb2-baa1-82ab2408e1e3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53962025-01-09T01:07:51.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f7459ef3-8030-4fb2-baa1-82ab2408e1e3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53972025-01-09T01:07:52.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fcb3438-8532-46d9-b4cd-219fde4aeba0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53982025-01-09T01:07:52.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fcb3438-8532-46d9-b4cd-219fde4aeba0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
53992025-01-09T01:07:52.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fcb3438-8532-46d9-b4cd-219fde4aeba0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54002025-01-09T01:07:53.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3af5de85-04fb-46d9-96b2-40383ab593ae roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54012025-01-09T01:07:53.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3af5de85-04fb-46d9-96b2-40383ab593ae resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54022025-01-09T01:07:53.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3af5de85-04fb-46d9-96b2-40383ab593ae response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54032025-01-09T01:07:54.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = de54dac9-9b83-488f-9777-c6a835eca713 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54042025-01-09T01:07:54.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = de54dac9-9b83-488f-9777-c6a835eca713 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54052025-01-09T01:07:54.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = de54dac9-9b83-488f-9777-c6a835eca713 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54062025-01-09T01:07:56.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19b11b5d-cafe-48de-a3bc-4826ab6decbe roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54072025-01-09T01:07:56.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19b11b5d-cafe-48de-a3bc-4826ab6decbe resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54082025-01-09T01:07:56.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19b11b5d-cafe-48de-a3bc-4826ab6decbe response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54092025-01-09T01:07:56.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
54102025-01-09T01:07:56.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
54112025-01-09T01:07:56.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54122025-01-09T01:07:56.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54132025-01-09T01:07:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54142025-01-09T01:07:56.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54152025-01-09T01:07:56.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162025-01-09T01:07:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54172025-01-09T01:07:56.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54182025-01-09T01:07:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54192025-01-09T01:07:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54202025-01-09T01:07:56.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54212025-01-09T01:07:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222025-01-09T01:07:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
54232025-01-09T01:07:56.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54242025-01-09T01:07:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54252025-01-09T01:07:56.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
54262025-01-09T01:07:56.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.545014ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
54272025-01-09T01:07:56.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54282025-01-09T01:07:56.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54292025-01-09T01:07:56.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.91713ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54302025-01-09T01:07:57.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8e814c9-3112-47d8-aa64-5cb185b7ba49 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54312025-01-09T01:07:57.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8e814c9-3112-47d8-aa64-5cb185b7ba49 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54322025-01-09T01:07:57.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8e814c9-3112-47d8-aa64-5cb185b7ba49 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54332025-01-09T01:07:58.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a8e95176-6db1-4b91-8d7f-fe2043b2e2bd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54342025-01-09T01:07:58.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a8e95176-6db1-4b91-8d7f-fe2043b2e2bd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54352025-01-09T01:07:58.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a8e95176-6db1-4b91-8d7f-fe2043b2e2bd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54362025-01-09T01:07:59.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1528a84f-5278-48d7-b3b9-e6775300c32e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54372025-01-09T01:07:59.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1528a84f-5278-48d7-b3b9-e6775300c32e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54382025-01-09T01:07:59.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1528a84f-5278-48d7-b3b9-e6775300c32e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54392025-01-09T01:07:59.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = 3d992cca-10e1-48f6-b175-410f338c3b06 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
54402025-01-09T01:07:59.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = 3d992cca-10e1-48f6-b175-410f338c3b06 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
54412025-01-09T01:07:59.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = 3d992cca-10e1-48f6-b175-410f338c3b06 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
54422025-01-09T01:07:59.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = c1258d0f-08fd-4d23-896c-4e2c3daba7c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
54432025-01-09T01:07:59.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = c1258d0f-08fd-4d23-896c-4e2c3daba7c3 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
54442025-01-09T01:07:59.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = c1258d0f-08fd-4d23-896c-4e2c3daba7c3 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
54452025-01-09T01:07:59.940ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 992c68fc-6524-468c-8778-91cec674350c response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
54462025-01-09T01:08:00.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4b19772a-b439-498b-b5f4-ed81401a7b79 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54472025-01-09T01:08:00.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4b19772a-b439-498b-b5f4-ed81401a7b79 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54482025-01-09T01:08:00.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4b19772a-b439-498b-b5f4-ed81401a7b79 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54492025-01-09T01:08:01.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 827305b4-135f-4c63-8233-98c46088869f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54502025-01-09T01:08:01.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 827305b4-135f-4c63-8233-98c46088869f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54512025-01-09T01:08:01.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 827305b4-135f-4c63-8233-98c46088869f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54522025-01-09T01:08:02.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03891740-851a-4d76-81df-8184555738c7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54532025-01-09T01:08:02.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03891740-851a-4d76-81df-8184555738c7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54542025-01-09T01:08:02.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 03891740-851a-4d76-81df-8184555738c7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54552025-01-09T01:08:03.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a37bad3-1588-40c2-8477-6b9715692176 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54562025-01-09T01:08:03.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a37bad3-1588-40c2-8477-6b9715692176 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54572025-01-09T01:08:03.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a37bad3-1588-40c2-8477-6b9715692176 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54582025-01-09T01:08:04.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8133fdf-7f20-45a6-b42c-3f31a9554bf8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54592025-01-09T01:08:04.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8133fdf-7f20-45a6-b42c-3f31a9554bf8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54602025-01-09T01:08:04.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8133fdf-7f20-45a6-b42c-3f31a9554bf8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54612025-01-09T01:08:05.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd347662-91d9-4ac8-a789-76508a13c2ef roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54622025-01-09T01:08:05.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd347662-91d9-4ac8-a789-76508a13c2ef resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54632025-01-09T01:08:05.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd347662-91d9-4ac8-a789-76508a13c2ef response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54642025-01-09T01:08:06.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 661017eb-cb85-4c8e-8a06-2d9d87effb2e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54652025-01-09T01:08:06.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 661017eb-cb85-4c8e-8a06-2d9d87effb2e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54662025-01-09T01:08:06.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 661017eb-cb85-4c8e-8a06-2d9d87effb2e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54672025-01-09T01:08:06.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
54682025-01-09T01:08:06.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
54692025-01-09T01:08:06.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54702025-01-09T01:08:06.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54712025-01-09T01:08:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54722025-01-09T01:08:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54732025-01-09T01:08:06.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742025-01-09T01:08:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54752025-01-09T01:08:06.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54762025-01-09T01:08:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54772025-01-09T01:08:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54782025-01-09T01:08:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54792025-01-09T01:08:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802025-01-09T01:08:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
54812025-01-09T01:08:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54822025-01-09T01:08:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54832025-01-09T01:08:06.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
54842025-01-09T01:08:06.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.733233ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
54852025-01-09T01:08:06.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54862025-01-09T01:08:06.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54872025-01-09T01:08:06.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.695382ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54882025-01-09T01:08:07.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a403258e-1497-4751-b24b-b945a4485277 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54892025-01-09T01:08:07.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a403258e-1497-4751-b24b-b945a4485277 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54902025-01-09T01:08:07.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a403258e-1497-4751-b24b-b945a4485277 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54912025-01-09T01:08:08.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff76f6c9-c556-45a6-979b-f13710ccabf4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54922025-01-09T01:08:08.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff76f6c9-c556-45a6-979b-f13710ccabf4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54932025-01-09T01:08:08.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ff76f6c9-c556-45a6-979b-f13710ccabf4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54942025-01-09T01:08:09.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f190a79f-8928-4ecb-8ea4-7438f36e9313 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54952025-01-09T01:08:09.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f190a79f-8928-4ecb-8ea4-7438f36e9313 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54962025-01-09T01:08:09.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f190a79f-8928-4ecb-8ea4-7438f36e9313 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54972025-01-09T01:08:09.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 505 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 6f316c02-9ba1-49a3-a60c-571cd55022b0 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
54982025-01-09T01:08:10.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ae9e6c06-9719-4bef-8508-c9892b015d5c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
54992025-01-09T01:08:10.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ae9e6c06-9719-4bef-8508-c9892b015d5c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55002025-01-09T01:08:10.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ae9e6c06-9719-4bef-8508-c9892b015d5c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55012025-01-09T01:08:11.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fb5a9b50-b7e4-4080-89de-4c6705e0465a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55022025-01-09T01:08:11.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fb5a9b50-b7e4-4080-89de-4c6705e0465a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55032025-01-09T01:08:11.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fb5a9b50-b7e4-4080-89de-4c6705e0465a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55042025-01-09T01:08:12.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49312da6-a159-43da-ab51-1c4dd53fc648 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55052025-01-09T01:08:12.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49312da6-a159-43da-ab51-1c4dd53fc648 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55062025-01-09T01:08:12.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49312da6-a159-43da-ab51-1c4dd53fc648 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55072025-01-09T01:08:13.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8aeb73a-c96b-4f79-9568-b0a8c6380870 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55082025-01-09T01:08:13.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8aeb73a-c96b-4f79-9568-b0a8c6380870 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55092025-01-09T01:08:13.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8aeb73a-c96b-4f79-9568-b0a8c6380870 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55102025-01-09T01:08:14.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 70bf949d-08ce-4b9b-a10c-0ffadb6bc1a8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55112025-01-09T01:08:14.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 70bf949d-08ce-4b9b-a10c-0ffadb6bc1a8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55122025-01-09T01:08:14.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 70bf949d-08ce-4b9b-a10c-0ffadb6bc1a8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55132025-01-09T01:08:15.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f65cc22b-a62b-4626-bed0-5792c8fb9a94 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55142025-01-09T01:08:15.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f65cc22b-a62b-4626-bed0-5792c8fb9a94 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55152025-01-09T01:08:15.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f65cc22b-a62b-4626-bed0-5792c8fb9a94 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55162025-01-09T01:08:16.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 182e5af3-222d-4555-b0d9-bfdc3fc0b905 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55172025-01-09T01:08:16.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 182e5af3-222d-4555-b0d9-bfdc3fc0b905 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55182025-01-09T01:08:16.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 182e5af3-222d-4555-b0d9-bfdc3fc0b905 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
55192025-01-09T01:08:16.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
55202025-01-09T01:08:16.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55212025-01-09T01:08:16.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
55222025-01-09T01:08:16.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55232025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55242025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55252025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
55262025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55272025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
55282025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55292025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
55302025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55312025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55322025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
55332025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
55342025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55352025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
55362025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55372025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55382025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
55392025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
55402025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55412025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55422025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
55432025-01-09T01:08:16.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55442025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
55452025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55462025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
55472025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55482025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
55492025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55502025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
55512025-01-09T01:08:16.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55522025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
55532025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55542025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55552025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
55562025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55572025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55582025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55592025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55602025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55612025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55622025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55632025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55642025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55652025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55662025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55672025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55682025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55692025-01-09T01:08:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55702025-01-09T01:08:16.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1340, tv_nsec: 362542261 } })
55712025-01-09T01:08:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
55722025-01-09T01:08:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1340, tv_nsec: 362978311 } })
55732025-01-09T01:08:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
55742025-01-09T01:08:16.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55752025-01-09T01:08:16.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55762025-01-09T01:08:16.903ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.606001ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55772025-01-09T01:08:16.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55782025-01-09T01:08:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55792025-01-09T01:08:16.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55802025-01-09T01:08:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55812025-01-09T01:08:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55822025-01-09T01:08:16.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55832025-01-09T01:08:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55842025-01-09T01:08:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55852025-01-09T01:08:16.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55862025-01-09T01:08:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55872025-01-09T01:08:16.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55882025-01-09T01:08:16.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.399875ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
55892025-01-09T01:08:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55902025-01-09T01:08:16.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55912025-01-09T01:08:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55922025-01-09T01:08:16.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55932025-01-09T01:08:16.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55942025-01-09T01:08:16.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55952025-01-09T01:08:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55962025-01-09T01:08:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55972025-01-09T01:08:16.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55982025-01-09T01:08:16.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55992025-01-09T01:08:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56002025-01-09T01:08:16.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56012025-01-09T01:08:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56022025-01-09T01:08:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56032025-01-09T01:08:16.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56042025-01-09T01:08:16.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56052025-01-09T01:08:16.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56062025-01-09T01:08:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56072025-01-09T01:08:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56082025-01-09T01:08:16.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56092025-01-09T01:08:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56102025-01-09T01:08:16.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56112025-01-09T01:08:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56122025-01-09T01:08:16.950ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56132025-01-09T01:08:16.950ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56142025-01-09T01:08:16.950ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56152025-01-09T01:08:16.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56162025-01-09T01:08:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56172025-01-09T01:08:16.950ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56182025-01-09T01:08:16.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.188035ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
56192025-01-09T01:08:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56202025-01-09T01:08:16.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56212025-01-09T01:08:16.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.126109ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56222025-01-09T01:08:16.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.467787ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56232025-01-09T01:08:16.953ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56242025-01-09T01:08:16.953ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56252025-01-09T01:08:16.953ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56262025-01-09T01:08:16.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56272025-01-09T01:08:16.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56282025-01-09T01:08:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56292025-01-09T01:08:16.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56302025-01-09T01:08:16.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56312025-01-09T01:08:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56322025-01-09T01:08:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56332025-01-09T01:08:16.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1340, tv_nsec: 420285324 } })
56342025-01-09T01:08:16.959ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
56352025-01-09T01:08:16.960ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56362025-01-09T01:08:16.960ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.504295ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56372025-01-09T01:08:16.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.906784ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56382025-01-09T01:08:16.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56392025-01-09T01:08:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56402025-01-09T01:08:16.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56412025-01-09T01:08:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56422025-01-09T01:08:16.969ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 69.623241ms iteration = 12 status = {"physical_disks_added":0}
56432025-01-09T01:08:16.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442025-01-09T01:08:16.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56452025-01-09T01:08:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
56462025-01-09T01:08:16.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56472025-01-09T01:08:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56482025-01-09T01:08:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
56492025-01-09T01:08:16.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56502025-01-09T01:08:16.974ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.353658ms iteration = 10 status = 0
56512025-01-09T01:08:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56522025-01-09T01:08:16.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56532025-01-09T01:08:16.978ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56542025-01-09T01:08:16.978ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25dfed4e-e79c-4be0-8982-3d1177d2f6b8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:08:16 GMT"} })
56552025-01-09T01:08:16.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56562025-01-09T01:08:16.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56572025-01-09T01:08:16.980ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56582025-01-09T01:08:16.980ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56592025-01-09T01:08:16.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56602025-01-09T01:08:16.980ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aefb350-b71a-4542-91c1-ab1dbc92100b", "content-length": "26", "date": "Thu, 09 Jan 2025 01:08:16 GMT"} })
56612025-01-09T01:08:16.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56622025-01-09T01:08:16.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56632025-01-09T01:08:16.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56642025-01-09T01:08:16.994ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
56652025-01-09T01:08:16.994ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.780338ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
56662025-01-09T01:08:16.998ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56672025-01-09T01:08:16.998ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56682025-01-09T01:08:16.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.304608ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56692025-01-09T01:08:17.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56702025-01-09T01:08:17.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56712025-01-09T01:08:17.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.013565ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56722025-01-09T01:08:17.049ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
56732025-01-09T01:08:17.049ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56742025-01-09T01:08:17.049ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "752e542f-f963-4177-a39e-2ee0b5424765", "content-length": "26", "date": "Thu, 09 Jan 2025 01:08:16 GMT"} })
56752025-01-09T01:08:17.049ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56762025-01-09T01:08:17.051ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
56772025-01-09T01:08:17.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56782025-01-09T01:08:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56792025-01-09T01:08:17.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56802025-01-09T01:08:17.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56812025-01-09T01:08:17.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56822025-01-09T01:08:17.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56832025-01-09T01:08:17.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56842025-01-09T01:08:17.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56852025-01-09T01:08:17.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56862025-01-09T01:08:17.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56872025-01-09T01:08:17.075ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56882025-01-09T01:08:17.075ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b261e61a-c06e-45ef-baf4-a5d992a6b1a6", "content-length": "1", "date": "Thu, 09 Jan 2025 01:08:16 GMT"} })
56892025-01-09T01:08:17.076ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56902025-01-09T01:08:17.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56912025-01-09T01:08:17.078ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.770796ms iteration = 10 status = null
56922025-01-09T01:08:17.098ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 199.692595ms iteration = 10 status = {}
56932025-01-09T01:08:17.214ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56942025-01-09T01:08:17.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6c1a32-f86e-4f7b-982a-a1ad3812c47c", "content-length": "691", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
56952025-01-09T01:08:17.214ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56962025-01-09T01:08:17.214ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56972025-01-09T01:08:17.214ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56982025-01-09T01:08:17.216ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.813298ms iteration = 10 status = {}
56992025-01-09T01:08:17.268ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57002025-01-09T01:08:17.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57012025-01-09T01:08:17.269ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "07124e44-2ac0-4499-a9bf-6ed83d6d6f44", "content-length": "372", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57022025-01-09T01:08:17.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57032025-01-09T01:08:17.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57042025-01-09T01:08:17.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57052025-01-09T01:08:17.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57062025-01-09T01:08:17.305ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
57072025-01-09T01:08:17.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57082025-01-09T01:08:17.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57092025-01-09T01:08:17.312ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57102025-01-09T01:08:17.312ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57112025-01-09T01:08:17.312ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6e8c63af-d249-4a52-a225-255f0bae6276", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57122025-01-09T01:08:17.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57132025-01-09T01:08:17.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57142025-01-09T01:08:17.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57152025-01-09T01:08:17.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57162025-01-09T01:08:17.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57172025-01-09T01:08:17.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "86b8e8bb-912e-4d7d-b0c1-e837ab86da35", "content-length": "134", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57182025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57192025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
57202025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57212025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57222025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57232025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57242025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57252025-01-09T01:08:17.316ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57262025-01-09T01:08:17.317ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57272025-01-09T01:08:17.317ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57282025-01-09T01:08:17.317ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
57292025-01-09T01:08:17.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57302025-01-09T01:08:17.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57312025-01-09T01:08:17.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57322025-01-09T01:08:17.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57332025-01-09T01:08:17.319ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57342025-01-09T01:08:17.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8df043b8-3ab8-4889-8a98-4e9bc20e608b", "content-length": "2", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57352025-01-09T01:08:17.319ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57362025-01-09T01:08:17.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e97645e7-cea3-421c-8ad6-c1ce32bd8af5", "content-length": "52", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57372025-01-09T01:08:17.319ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
57382025-01-09T01:08:17.319ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57392025-01-09T01:08:17.321ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57402025-01-09T01:08:17.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57412025-01-09T01:08:17.417ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "65304c86-d535-4ad6-9d54-18b9ff0e7297", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57422025-01-09T01:08:17.417ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
57432025-01-09T01:08:17.417ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57442025-01-09T01:08:17.417ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e3c0c69d-a78a-4626-89d9-10da9d770f92", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57452025-01-09T01:08:17.419ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 519.46667ms iteration = 10 status = {}
57462025-01-09T01:08:17.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa08e28a-4e86-4314-be4c-76c2de3315a6", "content-length": "682", "date": "Thu, 09 Jan 2025 01:08:17 GMT"} })
57472025-01-09T01:08:17.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57482025-01-09T01:08:17.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57492025-01-09T01:08:17.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57502025-01-09T01:08:17.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57512025-01-09T01:08:17.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57522025-01-09T01:08:17.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57532025-01-09T01:08:17.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57542025-01-09T01:08:17.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57552025-01-09T01:08:17.435ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 535.745037ms iteration = 10 status = {}
57562025-01-09T01:08:17.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 14fc16fd-43a2-4626-949f-0e70112eebf6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57572025-01-09T01:08:17.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 14fc16fd-43a2-4626-949f-0e70112eebf6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57582025-01-09T01:08:17.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 14fc16fd-43a2-4626-949f-0e70112eebf6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57592025-01-09T01:08:18.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85fe3537-6327-4c00-960e-1d0a71af9181 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57602025-01-09T01:08:18.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85fe3537-6327-4c00-960e-1d0a71af9181 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57612025-01-09T01:08:18.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85fe3537-6327-4c00-960e-1d0a71af9181 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57622025-01-09T01:08:19.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 995be060-12bd-4ad2-8af7-940ba0f0e882 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57632025-01-09T01:08:19.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 995be060-12bd-4ad2-8af7-940ba0f0e882 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57642025-01-09T01:08:19.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 995be060-12bd-4ad2-8af7-940ba0f0e882 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57652025-01-09T01:08:19.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 45f7c29b-236b-42e8-bc2f-f47cd407a73b response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
57662025-01-09T01:08:20.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 812d49a0-f587-4f2a-bb8e-1548b331b215 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57672025-01-09T01:08:20.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 812d49a0-f587-4f2a-bb8e-1548b331b215 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57682025-01-09T01:08:20.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 812d49a0-f587-4f2a-bb8e-1548b331b215 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57692025-01-09T01:08:21.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5be32128-f3c1-402e-bf28-6442fefe18c3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57702025-01-09T01:08:21.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5be32128-f3c1-402e-bf28-6442fefe18c3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57712025-01-09T01:08:21.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5be32128-f3c1-402e-bf28-6442fefe18c3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57722025-01-09T01:08:22.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a955dc80-ecfd-47eb-8df0-eeea66d97186 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57732025-01-09T01:08:22.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a955dc80-ecfd-47eb-8df0-eeea66d97186 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57742025-01-09T01:08:22.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a955dc80-ecfd-47eb-8df0-eeea66d97186 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57752025-01-09T01:08:23.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3cc46f16-d4ee-4290-aaf5-fac7ab0b0d5b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57762025-01-09T01:08:23.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3cc46f16-d4ee-4290-aaf5-fac7ab0b0d5b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57772025-01-09T01:08:23.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3cc46f16-d4ee-4290-aaf5-fac7ab0b0d5b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57782025-01-09T01:08:24.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 14a217f3-fd13-4221-a94a-2355c5342b1b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57792025-01-09T01:08:24.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 14a217f3-fd13-4221-a94a-2355c5342b1b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57802025-01-09T01:08:24.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 14a217f3-fd13-4221-a94a-2355c5342b1b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57812025-01-09T01:08:25.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2903f438-ebf2-453b-a26a-8546434d8457 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57822025-01-09T01:08:25.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2903f438-ebf2-453b-a26a-8546434d8457 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57832025-01-09T01:08:25.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2903f438-ebf2-453b-a26a-8546434d8457 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57842025-01-09T01:08:26.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0d44b710-4459-4d20-bf43-84462987dcd0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57852025-01-09T01:08:26.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0d44b710-4459-4d20-bf43-84462987dcd0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57862025-01-09T01:08:26.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0d44b710-4459-4d20-bf43-84462987dcd0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
57872025-01-09T01:08:26.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
57882025-01-09T01:08:26.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
57892025-01-09T01:08:26.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57902025-01-09T01:08:26.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57912025-01-09T01:08:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57922025-01-09T01:08:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57932025-01-09T01:08:26.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57942025-01-09T01:08:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57952025-01-09T01:08:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57962025-01-09T01:08:26.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57972025-01-09T01:08:26.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57982025-01-09T01:08:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57992025-01-09T01:08:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58002025-01-09T01:08:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58012025-01-09T01:08:26.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58022025-01-09T01:08:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
58032025-01-09T01:08:26.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58042025-01-09T01:08:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58052025-01-09T01:08:26.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
58062025-01-09T01:08:26.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.847361ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
58072025-01-09T01:08:26.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.788297ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58082025-01-09T01:08:27.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1c91d3ca-977d-4b98-89f5-62c43e868672 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58092025-01-09T01:08:27.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1c91d3ca-977d-4b98-89f5-62c43e868672 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58102025-01-09T01:08:27.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1c91d3ca-977d-4b98-89f5-62c43e868672 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58112025-01-09T01:08:28.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 91f7c55b-7427-4b4a-b10f-7a2cea76ad38 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58122025-01-09T01:08:28.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 91f7c55b-7427-4b4a-b10f-7a2cea76ad38 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58132025-01-09T01:08:28.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 91f7c55b-7427-4b4a-b10f-7a2cea76ad38 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58142025-01-09T01:08:29.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b270dcad-452d-49d4-a9f7-9c294ec652f2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58152025-01-09T01:08:29.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b270dcad-452d-49d4-a9f7-9c294ec652f2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58162025-01-09T01:08:29.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b270dcad-452d-49d4-a9f7-9c294ec652f2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58172025-01-09T01:08:29.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = a5f0a23d-f919-4214-a8ad-8259e1f417b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
58182025-01-09T01:08:29.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = a5f0a23d-f919-4214-a8ad-8259e1f417b2 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
58192025-01-09T01:08:29.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = a5f0a23d-f919-4214-a8ad-8259e1f417b2 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
58202025-01-09T01:08:29.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = 854bc56a-1ea0-444a-b5a4-eedf71079b0f roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
58212025-01-09T01:08:29.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = 854bc56a-1ea0-444a-b5a4-eedf71079b0f resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
58222025-01-09T01:08:29.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40307 req_id = 854bc56a-1ea0-444a-b5a4-eedf71079b0f response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
58232025-01-09T01:08:29.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 7d643c51-1cec-47f5-bdd7-8e686266dcb1 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
58242025-01-09T01:08:30.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37b28ff9-6808-4e7e-9082-ba7b73ad3b2f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58252025-01-09T01:08:30.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37b28ff9-6808-4e7e-9082-ba7b73ad3b2f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58262025-01-09T01:08:30.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37b28ff9-6808-4e7e-9082-ba7b73ad3b2f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58272025-01-09T01:08:31.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 77e9a663-7e84-4114-bf90-6c842498afb3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58282025-01-09T01:08:31.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 77e9a663-7e84-4114-bf90-6c842498afb3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58292025-01-09T01:08:31.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 77e9a663-7e84-4114-bf90-6c842498afb3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58302025-01-09T01:08:32.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7f9d6b41-45fb-46e1-b536-8490ce2d59a2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58312025-01-09T01:08:32.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7f9d6b41-45fb-46e1-b536-8490ce2d59a2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58322025-01-09T01:08:32.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7f9d6b41-45fb-46e1-b536-8490ce2d59a2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58332025-01-09T01:08:33.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5bc36143-91ed-4baa-96ee-dc9ce1f91d9b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58342025-01-09T01:08:33.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5bc36143-91ed-4baa-96ee-dc9ce1f91d9b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58352025-01-09T01:08:33.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5bc36143-91ed-4baa-96ee-dc9ce1f91d9b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58362025-01-09T01:08:34.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3b74ed4-2a9b-4c81-9e65-1af591a8e8a5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58372025-01-09T01:08:34.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3b74ed4-2a9b-4c81-9e65-1af591a8e8a5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58382025-01-09T01:08:34.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3b74ed4-2a9b-4c81-9e65-1af591a8e8a5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58392025-01-09T01:08:35.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dedd353f-d57d-49c5-907c-59afcaafb6f2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58402025-01-09T01:08:35.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dedd353f-d57d-49c5-907c-59afcaafb6f2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58412025-01-09T01:08:35.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dedd353f-d57d-49c5-907c-59afcaafb6f2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58422025-01-09T01:08:36.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
58432025-01-09T01:08:36.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58442025-01-09T01:08:36.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
58452025-01-09T01:08:36.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58462025-01-09T01:08:36.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58472025-01-09T01:08:36.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58482025-01-09T01:08:36.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58492025-01-09T01:08:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58502025-01-09T01:08:36.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512025-01-09T01:08:36.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.317505ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58522025-01-09T01:08:36.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58532025-01-09T01:08:36.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58542025-01-09T01:08:36.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58552025-01-09T01:08:36.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58562025-01-09T01:08:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58572025-01-09T01:08:36.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582025-01-09T01:08:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
58592025-01-09T01:08:36.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58602025-01-09T01:08:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58612025-01-09T01:08:36.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
58622025-01-09T01:08:36.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.639416ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
58632025-01-09T01:08:36.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9843e61e-80fa-4437-966b-71ee7757aabd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58642025-01-09T01:08:36.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9843e61e-80fa-4437-966b-71ee7757aabd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58652025-01-09T01:08:36.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9843e61e-80fa-4437-966b-71ee7757aabd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58662025-01-09T01:08:37.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7a650853-4eb0-49aa-ad6a-1a2e8e183d92 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58672025-01-09T01:08:37.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7a650853-4eb0-49aa-ad6a-1a2e8e183d92 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58682025-01-09T01:08:37.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7a650853-4eb0-49aa-ad6a-1a2e8e183d92 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58692025-01-09T01:08:38.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dca8db5b-5a72-429d-9ad8-2b9d77f02784 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58702025-01-09T01:08:38.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dca8db5b-5a72-429d-9ad8-2b9d77f02784 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58712025-01-09T01:08:38.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dca8db5b-5a72-429d-9ad8-2b9d77f02784 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58722025-01-09T01:08:39.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 791 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 59929d33-7a85-4ae2-8143-6c8560cf530f response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
58732025-01-09T01:08:39.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0fa8ee42-e271-4cb9-a670-4d2823f99011 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58742025-01-09T01:08:40.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0fa8ee42-e271-4cb9-a670-4d2823f99011 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58752025-01-09T01:08:40.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0fa8ee42-e271-4cb9-a670-4d2823f99011 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58762025-01-09T01:08:41.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5487d629-15c5-4f53-b499-b44408cd4dd1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58772025-01-09T01:08:41.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5487d629-15c5-4f53-b499-b44408cd4dd1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58782025-01-09T01:08:41.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5487d629-15c5-4f53-b499-b44408cd4dd1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58792025-01-09T01:08:42.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1623a58c-56c3-4bec-9885-fce7b572aae6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58802025-01-09T01:08:42.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1623a58c-56c3-4bec-9885-fce7b572aae6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58812025-01-09T01:08:42.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1623a58c-56c3-4bec-9885-fce7b572aae6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58822025-01-09T01:08:43.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f50e9ee0-435f-42a8-a7cb-d470f7f172f0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58832025-01-09T01:08:43.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f50e9ee0-435f-42a8-a7cb-d470f7f172f0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58842025-01-09T01:08:43.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f50e9ee0-435f-42a8-a7cb-d470f7f172f0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58852025-01-09T01:08:44.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 654d1036-bf93-4a3e-90c0-c4c1a378803b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58862025-01-09T01:08:44.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 654d1036-bf93-4a3e-90c0-c4c1a378803b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58872025-01-09T01:08:44.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 654d1036-bf93-4a3e-90c0-c4c1a378803b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58882025-01-09T01:08:45.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4f2faba2-19c3-4f49-af21-f3daa126d419 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58892025-01-09T01:08:45.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4f2faba2-19c3-4f49-af21-f3daa126d419 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58902025-01-09T01:08:45.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4f2faba2-19c3-4f49-af21-f3daa126d419 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58912025-01-09T01:08:46.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 25deffc2-f49e-4d2f-99f5-bcabde5283be roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58922025-01-09T01:08:46.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 25deffc2-f49e-4d2f-99f5-bcabde5283be resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58932025-01-09T01:08:46.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 25deffc2-f49e-4d2f-99f5-bcabde5283be response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
58942025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
58952025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
58962025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
58972025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58982025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58992025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
59002025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59012025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59022025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59032025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
59042025-01-09T01:08:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:58:46.899126668 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59052025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59062025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
59072025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
59082025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59092025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
59102025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
59112025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59122025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
59132025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59142025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59152025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59162025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59172025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
59182025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
59192025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59202025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59212025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
59222025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59232025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
59242025-01-09T01:08:46.899ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
59252025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59262025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
59272025-01-09T01:08:46.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59282025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
59292025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59302025-01-09T01:08:46.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
59312025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
59322025-01-09T01:08:46.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.821\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
59332025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
59342025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
59352025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59362025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
59372025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59382025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
59392025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59402025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
59412025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
59422025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59432025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
59442025-01-09T01:08:46.900ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59452025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
59462025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59472025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59482025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
59492025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59502025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
59512025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59522025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
59532025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59542025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
59552025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59562025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
59572025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59582025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
59592025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59602025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59612025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
59622025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59632025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
59642025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59652025-01-09T01:08:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 360883776 } })
59662025-01-09T01:08:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 360918007 } })
59672025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59682025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59692025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59702025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59712025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59722025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59732025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59742025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59752025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59762025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59772025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
59782025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59792025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59802025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
59812025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59822025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59832025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59842025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59852025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59862025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
59872025-01-09T01:08:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.78879ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
59882025-01-09T01:08:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
59892025-01-09T01:08:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.902114ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
59902025-01-09T01:08:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59912025-01-09T01:08:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59922025-01-09T01:08:46.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 362862680 } })
59932025-01-09T01:08:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59942025-01-09T01:08:46.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
59952025-01-09T01:08:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59962025-01-09T01:08:46.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 363284210 } })
59972025-01-09T01:08:46.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
59982025-01-09T01:08:46.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:58:46.899126668 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59992025-01-09T01:08:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.790991ms iteration = 6 status = {"expiration":"2025-01-09T00:58:46.899126668Z","pruned":[]}
60002025-01-09T01:08:46.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60012025-01-09T01:08:46.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60022025-01-09T01:08:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60032025-01-09T01:08:46.910ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60042025-01-09T01:08:46.911ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.188082ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60052025-01-09T01:08:46.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60062025-01-09T01:08:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60072025-01-09T01:08:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60082025-01-09T01:08:46.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60092025-01-09T01:08:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60102025-01-09T01:08:46.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60112025-01-09T01:08:46.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60122025-01-09T01:08:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60132025-01-09T01:08:46.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60142025-01-09T01:08:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60152025-01-09T01:08:46.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60162025-01-09T01:08:46.920ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60172025-01-09T01:08:46.920ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.736688ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
60182025-01-09T01:08:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60192025-01-09T01:08:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60202025-01-09T01:08:46.923ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60212025-01-09T01:08:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60222025-01-09T01:08:46.927ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60232025-01-09T01:08:46.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60242025-01-09T01:08:46.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60252025-01-09T01:08:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60262025-01-09T01:08:46.931ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60272025-01-09T01:08:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60282025-01-09T01:08:46.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292025-01-09T01:08:46.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60302025-01-09T01:08:46.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60312025-01-09T01:08:46.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60322025-01-09T01:08:46.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60332025-01-09T01:08:46.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60342025-01-09T01:08:46.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60352025-01-09T01:08:46.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60362025-01-09T01:08:46.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60372025-01-09T01:08:46.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60382025-01-09T01:08:46.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60392025-01-09T01:08:46.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60402025-01-09T01:08:46.941ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60412025-01-09T01:08:46.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60422025-01-09T01:08:46.944ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60432025-01-09T01:08:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60442025-01-09T01:08:46.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60452025-01-09T01:08:46.946ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60462025-01-09T01:08:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60472025-01-09T01:08:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60482025-01-09T01:08:46.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60492025-01-09T01:08:46.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60502025-01-09T01:08:46.955ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 416547042 } })
60512025-01-09T01:08:46.956ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
60522025-01-09T01:08:46.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60532025-01-09T01:08:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.500393ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
60542025-01-09T01:08:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
60552025-01-09T01:08:46.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60562025-01-09T01:08:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60572025-01-09T01:08:46.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60582025-01-09T01:08:46.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60592025-01-09T01:08:46.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60602025-01-09T01:08:46.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60612025-01-09T01:08:46.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60622025-01-09T01:08:46.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60632025-01-09T01:08:46.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60642025-01-09T01:08:46.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60652025-01-09T01:08:46.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60662025-01-09T01:08:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60672025-01-09T01:08:46.978ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60682025-01-09T01:08:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60692025-01-09T01:08:46.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60702025-01-09T01:08:46.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60712025-01-09T01:08:46.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60722025-01-09T01:08:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60732025-01-09T01:08:46.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60742025-01-09T01:08:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60752025-01-09T01:08:46.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60762025-01-09T01:08:46.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60772025-01-09T01:08:46.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.904578ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60782025-01-09T01:08:46.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.76207ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
60792025-01-09T01:08:46.994ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
60802025-01-09T01:08:46.994ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.497392ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
60812025-01-09T01:08:46.994ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
60822025-01-09T01:08:46.994ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
60832025-01-09T01:08:46.994ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 94.839579ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
60842025-01-09T01:08:46.998ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60852025-01-09T01:08:46.998ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60862025-01-09T01:08:46.998ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60872025-01-09T01:08:46.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60882025-01-09T01:08:46.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60892025-01-09T01:08:47.007ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60902025-01-09T01:08:47.007ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60912025-01-09T01:08:47.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60922025-01-09T01:08:47.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60932025-01-09T01:08:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60942025-01-09T01:08:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60952025-01-09T01:08:47.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60962025-01-09T01:08:47.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60972025-01-09T01:08:47.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982025-01-09T01:08:47.012ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60992025-01-09T01:08:47.012ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61002025-01-09T01:08:47.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61012025-01-09T01:08:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61022025-01-09T01:08:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61032025-01-09T01:08:47.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61042025-01-09T01:08:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61052025-01-09T01:08:47.014ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61062025-01-09T01:08:47.014ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61072025-01-09T01:08:47.014ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.390571ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61082025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61092025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61102025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61112025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61122025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.506338ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61132025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61142025-01-09T01:08:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61152025-01-09T01:08:47.018ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61162025-01-09T01:08:47.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.515564ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61172025-01-09T01:08:47.019ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61182025-01-09T01:08:47.019ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61192025-01-09T01:08:47.019ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.159598ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61202025-01-09T01:08:47.020ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61212025-01-09T01:08:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61222025-01-09T01:08:47.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232025-01-09T01:08:47.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61242025-01-09T01:08:47.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61252025-01-09T01:08:47.022ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.471903ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61262025-01-09T01:08:47.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
61272025-01-09T01:08:47.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61282025-01-09T01:08:47.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61292025-01-09T01:08:47.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61302025-01-09T01:08:47.029ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.151314ms iteration = 11 status = 0
61312025-01-09T01:08:47.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61322025-01-09T01:08:47.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61332025-01-09T01:08:47.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61342025-01-09T01:08:47.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61352025-01-09T01:08:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61362025-01-09T01:08:47.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372025-01-09T01:08:47.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61382025-01-09T01:08:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61392025-01-09T01:08:47.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61402025-01-09T01:08:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61412025-01-09T01:08:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61422025-01-09T01:08:47.058ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61432025-01-09T01:08:47.059ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61442025-01-09T01:08:47.059ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61452025-01-09T01:08:47.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61462025-01-09T01:08:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61472025-01-09T01:08:47.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482025-01-09T01:08:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61492025-01-09T01:08:47.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61502025-01-09T01:08:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61512025-01-09T01:08:47.071ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61522025-01-09T01:08:47.071ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
61532025-01-09T01:08:47.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61542025-01-09T01:08:47.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61552025-01-09T01:08:47.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61562025-01-09T01:08:47.075ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61572025-01-09T01:08:47.075ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61582025-01-09T01:08:47.076ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f20aec71-781f-4c07-8cb5-fd33c0a0db3e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:08:46 GMT"} })
61592025-01-09T01:08:47.076ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61602025-01-09T01:08:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61612025-01-09T01:08:47.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61622025-01-09T01:08:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61632025-01-09T01:08:47.078ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61642025-01-09T01:08:47.080ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
61652025-01-09T01:08:47.080ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
61662025-01-09T01:08:47.080ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
61672025-01-09T01:08:47.080ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 181.672029ms iteration = 6 status = {"generation":2}
61682025-01-09T01:08:47.084ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
61692025-01-09T01:08:47.084ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61702025-01-09T01:08:47.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61712025-01-09T01:08:47.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61722025-01-09T01:08:47.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61732025-01-09T01:08:47.086ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
61742025-01-09T01:08:47.086ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.454139ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
61752025-01-09T01:08:47.087ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61762025-01-09T01:08:47.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61772025-01-09T01:08:47.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61782025-01-09T01:08:47.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61792025-01-09T01:08:47.096ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
61802025-01-09T01:08:47.096ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
61812025-01-09T01:08:47.096ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
61822025-01-09T01:08:47.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 197.110547ms iteration = 6 status = {"generation":1}
61832025-01-09T01:08:47.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 197.064816ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61842025-01-09T01:08:47.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61852025-01-09T01:08:47.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61862025-01-09T01:08:47.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61872025-01-09T01:08:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61882025-01-09T01:08:47.119ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 219.461931ms iteration = 13 status = {"physical_disks_added":0}
61892025-01-09T01:08:47.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a8e8fc1-c64a-4f2c-aad6-36a0c09f2c85 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
61902025-01-09T01:08:47.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a8e8fc1-c64a-4f2c-aad6-36a0c09f2c85 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
61912025-01-09T01:08:47.161ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61922025-01-09T01:08:47.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 261.629853ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61932025-01-09T01:08:47.282ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61942025-01-09T01:08:47.282ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61952025-01-09T01:08:47.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61962025-01-09T01:08:47.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61972025-01-09T01:08:47.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61982025-01-09T01:08:47.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a8e8fc1-c64a-4f2c-aad6-36a0c09f2c85 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
61992025-01-09T01:08:47.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62002025-01-09T01:08:47.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62012025-01-09T01:08:47.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62022025-01-09T01:08:47.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62032025-01-09T01:08:47.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042025-01-09T01:08:47.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62052025-01-09T01:08:47.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62062025-01-09T01:08:47.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62072025-01-09T01:08:47.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62082025-01-09T01:08:47.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62092025-01-09T01:08:47.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62102025-01-09T01:08:47.294ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62112025-01-09T01:08:47.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62122025-01-09T01:08:47.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62132025-01-09T01:08:47.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62142025-01-09T01:08:47.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62152025-01-09T01:08:47.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62162025-01-09T01:08:47.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62172025-01-09T01:08:47.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62182025-01-09T01:08:47.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62192025-01-09T01:08:47.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62202025-01-09T01:08:47.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62212025-01-09T01:08:47.302ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62222025-01-09T01:08:47.302ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62232025-01-09T01:08:47.303ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a5182e-b0bc-42c1-98a9-c1a15a3bdcae", "content-length": "26", "date": "Thu, 09 Jan 2025 01:08:46 GMT"} })
62242025-01-09T01:08:47.303ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62252025-01-09T01:08:47.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62262025-01-09T01:08:47.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62272025-01-09T01:08:47.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62282025-01-09T01:08:47.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62292025-01-09T01:08:47.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62302025-01-09T01:08:47.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62312025-01-09T01:08:47.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62322025-01-09T01:08:47.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62332025-01-09T01:08:47.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62342025-01-09T01:08:47.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62352025-01-09T01:08:47.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62362025-01-09T01:08:47.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62372025-01-09T01:08:47.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62382025-01-09T01:08:47.316ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62392025-01-09T01:08:47.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62402025-01-09T01:08:47.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62412025-01-09T01:08:47.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62422025-01-09T01:08:47.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "20745d8b-e5a5-40cf-a984-297f2f6dc7a5", "content-length": "372", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
62432025-01-09T01:08:47.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62442025-01-09T01:08:47.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62452025-01-09T01:08:47.352ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
62462025-01-09T01:08:47.352ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62472025-01-09T01:08:47.353ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7c45a36-f6f5-4ace-83e8-eb0df20a042c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:08:46 GMT"} })
62482025-01-09T01:08:47.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62492025-01-09T01:08:47.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
62502025-01-09T01:08:47.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62512025-01-09T01:08:47.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62522025-01-09T01:08:47.387ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 488.214775ms iteration = 11 status = {}
62532025-01-09T01:08:47.393ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62542025-01-09T01:08:47.393ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62552025-01-09T01:08:47.393ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d87a9a70-d5ac-43bb-8120-e20b37f8642a", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
62562025-01-09T01:08:47.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62572025-01-09T01:08:47.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62582025-01-09T01:08:47.404ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62592025-01-09T01:08:47.405ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d828bda9-c9d3-404f-a23f-675c3468b1aa", "date": "Thu, 09 Jan 2025 01:08:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62602025-01-09T01:08:47.405ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62612025-01-09T01:08:47.407ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ab780bf0-94c2-4fee-bd1b-c15fe39e1029", "date": "Thu, 09 Jan 2025 01:08:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62622025-01-09T01:08:47.407ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62632025-01-09T01:08:47.409ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62642025-01-09T01:08:47.409ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 510.368885ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62652025-01-09T01:08:47.453ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62662025-01-09T01:08:47.454ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "29e458d6-6815-4318-8438-f045d3c94c09", "content-length": "1", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
62672025-01-09T01:08:47.456ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62682025-01-09T01:08:47.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62692025-01-09T01:08:47.547ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62702025-01-09T01:08:47.559ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62712025-01-09T01:08:47.559ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc016df-06cb-4bc5-a2eb-98cf16963f4b", "content-length": "691", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
62722025-01-09T01:08:47.560ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62732025-01-09T01:08:47.560ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62742025-01-09T01:08:47.560ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62752025-01-09T01:08:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 661.273549ms iteration = 11 status = {}
62762025-01-09T01:08:47.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62772025-01-09T01:08:47.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62782025-01-09T01:08:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 663.138181ms iteration = 11 status = null
62792025-01-09T01:08:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62802025-01-09T01:08:47.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
62812025-01-09T01:08:47.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62822025-01-09T01:08:47.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62832025-01-09T01:08:47.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62842025-01-09T01:08:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62852025-01-09T01:08:47.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62862025-01-09T01:08:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62872025-01-09T01:08:47.568ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62882025-01-09T01:08:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62892025-01-09T01:08:47.568ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62902025-01-09T01:08:47.568ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62912025-01-09T01:08:47.569ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b6675d6a-ca2c-4f61-974f-557e17dd914e", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
62922025-01-09T01:08:47.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62932025-01-09T01:08:47.571ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 671.335617ms iteration = 11 status = {}
62942025-01-09T01:08:47.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
62952025-01-09T01:08:47.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62962025-01-09T01:08:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62972025-01-09T01:08:47.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62982025-01-09T01:08:47.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62992025-01-09T01:08:47.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63002025-01-09T01:08:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63012025-01-09T01:08:47.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63022025-01-09T01:08:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63032025-01-09T01:08:47.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63042025-01-09T01:08:47.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63052025-01-09T01:08:47.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63062025-01-09T01:08:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63072025-01-09T01:08:47.586ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63082025-01-09T01:08:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63092025-01-09T01:08:47.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63102025-01-09T01:08:47.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63112025-01-09T01:08:47.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63122025-01-09T01:08:47.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63132025-01-09T01:08:47.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63142025-01-09T01:08:47.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63152025-01-09T01:08:47.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63162025-01-09T01:08:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63172025-01-09T01:08:47.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63182025-01-09T01:08:47.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63192025-01-09T01:08:47.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202025-01-09T01:08:47.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63212025-01-09T01:08:47.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63222025-01-09T01:08:47.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63232025-01-09T01:08:47.608ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 32dc4ecd-b53e-48ec-96da-e27f9d50a7c1, kind: Service { id: cffb0aad-1932-4a44-891c-2739991d1934 }, name: Name("nexus-cffb0aad-1932-4a44-891c-2739991d1934"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5bb6cca4-8c89-42c7-8517-bbec55a75150, kind: Service { id: 5236fac0-d91c-403e-8658-32167d628d4d }, name: Name("nexus-5236fac0-d91c-403e-8658-32167d628d4d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7464f2e2-2881-4143-9c24-14f2de0a4d6a, kind: Service { id: bc5aeb1b-883b-4e3c-84e4-bb4b98458327 }, name: Name("nexus-bc5aeb1b-883b-4e3c-84e4-bb4b98458327"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5082dfc8-feb0-4452-a8c4-3c0037101230, kind: Service { id: 71878588-3bc5-4be9-bddb-893f09285184 }, name: Name("external-dns-71878588-3bc5-4be9-bddb-893f09285184"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 84c8b3b4-9160-4f8a-9f93-e97bdb5fa721, kind: Service { id: 870344ce-2728-444f-8d5a-e3771e15477e }, name: Name("external-dns-870344ce-2728-444f-8d5a-e3771e15477e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 234])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
63242025-01-09T01:08:47.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63252025-01-09T01:08:47.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63262025-01-09T01:08:47.609ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272025-01-09T01:08:47.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
63282025-01-09T01:08:47.611ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63292025-01-09T01:08:47.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63302025-01-09T01:08:47.613ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
63312025-01-09T01:08:47.613ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5082dfc8-feb0-4452-a8c4-3c0037101230, kind: Service { id: 71878588-3bc5-4be9-bddb-893f09285184 }, name: Name("external-dns-71878588-3bc5-4be9-bddb-893f09285184"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 84c8b3b4-9160-4f8a-9f93-e97bdb5fa721, kind: Service { id: 870344ce-2728-444f-8d5a-e3771e15477e }, name: Name("external-dns-870344ce-2728-444f-8d5a-e3771e15477e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 234])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32dc4ecd-b53e-48ec-96da-e27f9d50a7c1, kind: Service { id: cffb0aad-1932-4a44-891c-2739991d1934 }, name: Name("nexus-cffb0aad-1932-4a44-891c-2739991d1934"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5bb6cca4-8c89-42c7-8517-bbec55a75150, kind: Service { id: 5236fac0-d91c-403e-8658-32167d628d4d }, name: Name("nexus-5236fac0-d91c-403e-8658-32167d628d4d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7464f2e2-2881-4143-9c24-14f2de0a4d6a, kind: Service { id: bc5aeb1b-883b-4e3c-84e4-bb4b98458327 }, name: Name("nexus-bc5aeb1b-883b-4e3c-84e4-bb4b98458327"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
63322025-01-09T01:08:47.613ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
63332025-01-09T01:08:47.615ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63342025-01-09T01:08:47.615ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7a4aa4bc-48fb-4876-9771-77b0bf2992b4", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63352025-01-09T01:08:47.615ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63362025-01-09T01:08:47.617ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "09f4b459-bb05-4a10-ab95-00ac52afd3de", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63372025-01-09T01:08:47.617ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63382025-01-09T01:08:47.619ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "54a3194a-8de5-4b83-93cf-cbf5c73dae4a", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63392025-01-09T01:08:47.619ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63402025-01-09T01:08:47.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63412025-01-09T01:08:47.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63422025-01-09T01:08:47.621ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63432025-01-09T01:08:47.621ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 722.197744ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63442025-01-09T01:08:47.621ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
63452025-01-09T01:08:47.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63462025-01-09T01:08:47.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63472025-01-09T01:08:47.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63482025-01-09T01:08:47.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece201a0-b327-4e3d-8210-b904bc7e1cf9", "content-length": "134", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
63492025-01-09T01:08:47.630ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63502025-01-09T01:08:47.630ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
63512025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63522025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63532025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63542025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63552025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63562025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63572025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63582025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63592025-01-09T01:08:47.631ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
63602025-01-09T01:08:47.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63612025-01-09T01:08:47.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63622025-01-09T01:08:47.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63632025-01-09T01:08:47.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a555c37-f079-4016-b85b-89758d653b78", "content-length": "2", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
63642025-01-09T01:08:47.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63652025-01-09T01:08:47.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5366bdb4-568b-4d07-9cbb-ac53c227a056", "content-length": "52", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
63662025-01-09T01:08:47.633ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
63672025-01-09T01:08:47.633ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63682025-01-09T01:08:47.722ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, time_created: 2025-01-09T01:03:45.090062Z, time_modified: 2025-01-09T01:03:45.090062Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
63692025-01-09T01:08:47.722ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
63702025-01-09T01:08:47.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63712025-01-09T01:08:47.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63722025-01-09T01:08:47.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63732025-01-09T01:08:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63742025-01-09T01:08:47.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752025-01-09T01:08:47.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
63762025-01-09T01:08:47.737ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "378d68d1-e0c4-4420-9870-ce067f05e707", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
63772025-01-09T01:08:47.738ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
63782025-01-09T01:08:47.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63792025-01-09T01:08:47.738ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2501187-2def-46f4-9837-597a0fad2298", "content-length": "682", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
63802025-01-09T01:08:47.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63812025-01-09T01:08:47.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63822025-01-09T01:08:47.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63832025-01-09T01:08:47.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63842025-01-09T01:08:47.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63852025-01-09T01:08:47.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63862025-01-09T01:08:47.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63872025-01-09T01:08:47.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63882025-01-09T01:08:47.755ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 855.643885ms iteration = 11 status = {}
63892025-01-09T01:08:47.762ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
63902025-01-09T01:08:47.763ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1666f35a-300e-4c03-8ab4-23bd8121ae4a", "date": "Thu, 09 Jan 2025 01:08:47 GMT"} })
63912025-01-09T01:08:47.765ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
63922025-01-09T01:08:47.765ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 865.496677ms
63932025-01-09T01:08:47.765ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 865.504727ms iteration = 2 status = {}
63942025-01-09T01:08:48.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf5b3244-856c-4e96-b736-ffe60a6ec3db roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
63952025-01-09T01:08:48.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf5b3244-856c-4e96-b736-ffe60a6ec3db resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
63962025-01-09T01:08:48.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf5b3244-856c-4e96-b736-ffe60a6ec3db response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
63972025-01-09T01:08:49.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eda740a1-c354-41e3-97e8-b2109c86fb65 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
63982025-01-09T01:08:49.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eda740a1-c354-41e3-97e8-b2109c86fb65 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
63992025-01-09T01:08:49.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eda740a1-c354-41e3-97e8-b2109c86fb65 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64002025-01-09T01:08:49.940ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 9ba49ca8-6783-4c50-ab41-9943220333d4 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
64012025-01-09T01:08:50.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fc8ef034-3cee-454a-ac77-54694825c6ff roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64022025-01-09T01:08:50.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fc8ef034-3cee-454a-ac77-54694825c6ff resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64032025-01-09T01:08:50.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fc8ef034-3cee-454a-ac77-54694825c6ff response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64042025-01-09T01:08:51.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8bec2b7d-c8c0-4eca-81a1-f21eb16f2b14 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64052025-01-09T01:08:51.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8bec2b7d-c8c0-4eca-81a1-f21eb16f2b14 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64062025-01-09T01:08:51.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8bec2b7d-c8c0-4eca-81a1-f21eb16f2b14 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64072025-01-09T01:08:52.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8cafbd5-9a69-4978-8296-f2c582212388 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64082025-01-09T01:08:52.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8cafbd5-9a69-4978-8296-f2c582212388 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64092025-01-09T01:08:52.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8cafbd5-9a69-4978-8296-f2c582212388 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64102025-01-09T01:08:53.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76ef8c10-da20-43a1-a350-d53bb149272e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64112025-01-09T01:08:53.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76ef8c10-da20-43a1-a350-d53bb149272e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64122025-01-09T01:08:53.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76ef8c10-da20-43a1-a350-d53bb149272e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64132025-01-09T01:08:54.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55639792-6a8d-42e8-b6b1-0d376292af9b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64142025-01-09T01:08:54.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55639792-6a8d-42e8-b6b1-0d376292af9b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64152025-01-09T01:08:54.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55639792-6a8d-42e8-b6b1-0d376292af9b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64162025-01-09T01:08:55.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fd112bf-633e-4f38-9ae6-4259ddbee39c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64172025-01-09T01:08:55.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fd112bf-633e-4f38-9ae6-4259ddbee39c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64182025-01-09T01:08:55.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fd112bf-633e-4f38-9ae6-4259ddbee39c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64192025-01-09T01:08:56.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b593230-5319-46ba-a152-b9cd4a6e66ae roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64202025-01-09T01:08:56.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b593230-5319-46ba-a152-b9cd4a6e66ae resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64212025-01-09T01:08:56.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b593230-5319-46ba-a152-b9cd4a6e66ae response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64222025-01-09T01:08:56.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
64232025-01-09T01:08:56.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64242025-01-09T01:08:56.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
64252025-01-09T01:08:56.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64262025-01-09T01:08:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64272025-01-09T01:08:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64282025-01-09T01:08:56.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292025-01-09T01:08:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64302025-01-09T01:08:56.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64312025-01-09T01:08:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64322025-01-09T01:08:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64332025-01-09T01:08:56.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64342025-01-09T01:08:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64352025-01-09T01:08:56.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
64362025-01-09T01:08:56.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64372025-01-09T01:08:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64382025-01-09T01:08:56.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
64392025-01-09T01:08:56.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.764446ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
64402025-01-09T01:08:56.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64412025-01-09T01:08:56.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64422025-01-09T01:08:56.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.304113ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64432025-01-09T01:08:57.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 651d867f-7cf3-4440-a3dc-ee0975173129 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64442025-01-09T01:08:57.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 651d867f-7cf3-4440-a3dc-ee0975173129 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64452025-01-09T01:08:57.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 651d867f-7cf3-4440-a3dc-ee0975173129 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64462025-01-09T01:08:58.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f94a704e-ce7a-4a49-a140-b73886f9977a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64472025-01-09T01:08:58.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f94a704e-ce7a-4a49-a140-b73886f9977a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64482025-01-09T01:08:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f94a704e-ce7a-4a49-a140-b73886f9977a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64492025-01-09T01:08:59.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7ebcad6-655d-4111-a2a5-bece59a5eb69 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64502025-01-09T01:08:59.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7ebcad6-655d-4111-a2a5-bece59a5eb69 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64512025-01-09T01:08:59.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7ebcad6-655d-4111-a2a5-bece59a5eb69 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64522025-01-09T01:08:59.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 71ec1d1f-137e-4f58-af3f-1577503b13b3 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
64532025-01-09T01:09:00.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 47c1e812-6954-43e0-b2d8-4c67ced07495 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64542025-01-09T01:09:00.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 47c1e812-6954-43e0-b2d8-4c67ced07495 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64552025-01-09T01:09:00.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 47c1e812-6954-43e0-b2d8-4c67ced07495 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64562025-01-09T01:09:01.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49988bde-7f48-4d79-8939-bb0486f39d60 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64572025-01-09T01:09:01.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49988bde-7f48-4d79-8939-bb0486f39d60 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64582025-01-09T01:09:01.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49988bde-7f48-4d79-8939-bb0486f39d60 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64592025-01-09T01:09:02.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a38c961-b6a0-4aa1-9e36-a9cd2834b04e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64602025-01-09T01:09:02.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a38c961-b6a0-4aa1-9e36-a9cd2834b04e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64612025-01-09T01:09:02.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a38c961-b6a0-4aa1-9e36-a9cd2834b04e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64622025-01-09T01:09:03.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9bb7c85a-e677-4c85-96d9-3969f9dc7ffe roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64632025-01-09T01:09:03.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9bb7c85a-e677-4c85-96d9-3969f9dc7ffe resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64642025-01-09T01:09:03.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9bb7c85a-e677-4c85-96d9-3969f9dc7ffe response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64652025-01-09T01:09:04.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 659af403-910a-4dad-8a03-656a0eafd376 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64662025-01-09T01:09:04.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 659af403-910a-4dad-8a03-656a0eafd376 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64672025-01-09T01:09:04.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 659af403-910a-4dad-8a03-656a0eafd376 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64682025-01-09T01:09:05.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 59ca76b6-bd2f-46ec-aba0-a3a8148c1f60 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64692025-01-09T01:09:05.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 59ca76b6-bd2f-46ec-aba0-a3a8148c1f60 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64702025-01-09T01:09:05.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 59ca76b6-bd2f-46ec-aba0-a3a8148c1f60 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64712025-01-09T01:09:06.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 078e4551-9834-4bb5-b4f5-4af0f73c9349 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64722025-01-09T01:09:06.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 078e4551-9834-4bb5-b4f5-4af0f73c9349 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64732025-01-09T01:09:06.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 078e4551-9834-4bb5-b4f5-4af0f73c9349 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64742025-01-09T01:09:06.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
64752025-01-09T01:09:06.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
64762025-01-09T01:09:06.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64772025-01-09T01:09:06.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64782025-01-09T01:09:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64792025-01-09T01:09:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64802025-01-09T01:09:06.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64812025-01-09T01:09:06.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64822025-01-09T01:09:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64832025-01-09T01:09:06.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.603884ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64842025-01-09T01:09:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64852025-01-09T01:09:06.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64862025-01-09T01:09:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64872025-01-09T01:09:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64882025-01-09T01:09:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64892025-01-09T01:09:06.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902025-01-09T01:09:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
64912025-01-09T01:09:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64922025-01-09T01:09:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64932025-01-09T01:09:06.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
64942025-01-09T01:09:06.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.117611ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
64952025-01-09T01:09:07.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aaaa1719-d905-4071-b114-0c68c45bbd7b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64962025-01-09T01:09:07.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aaaa1719-d905-4071-b114-0c68c45bbd7b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64972025-01-09T01:09:07.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aaaa1719-d905-4071-b114-0c68c45bbd7b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64982025-01-09T01:09:08.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1967e262-f98e-4321-b517-68f83d5bc997 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
64992025-01-09T01:09:08.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1967e262-f98e-4321-b517-68f83d5bc997 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65002025-01-09T01:09:08.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1967e262-f98e-4321-b517-68f83d5bc997 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65012025-01-09T01:09:09.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ddcd242d-663b-4390-a7b4-7b20a63dc42c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65022025-01-09T01:09:09.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ddcd242d-663b-4390-a7b4-7b20a63dc42c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65032025-01-09T01:09:09.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ddcd242d-663b-4390-a7b4-7b20a63dc42c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65042025-01-09T01:09:09.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 6f793368-0673-4bd7-803b-8f281879b93d response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
65052025-01-09T01:09:10.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e8ab9879-e2ea-43c5-8ac6-b63fe5d6eb6a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65062025-01-09T01:09:10.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e8ab9879-e2ea-43c5-8ac6-b63fe5d6eb6a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65072025-01-09T01:09:10.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e8ab9879-e2ea-43c5-8ac6-b63fe5d6eb6a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65082025-01-09T01:09:11.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a00c9872-0ec3-4067-bd11-1440d568d547 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65092025-01-09T01:09:11.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a00c9872-0ec3-4067-bd11-1440d568d547 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65102025-01-09T01:09:11.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a00c9872-0ec3-4067-bd11-1440d568d547 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65112025-01-09T01:09:12.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 790929c2-a436-48b4-ba9a-f4915dcfa56a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65122025-01-09T01:09:12.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 790929c2-a436-48b4-ba9a-f4915dcfa56a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65132025-01-09T01:09:12.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 790929c2-a436-48b4-ba9a-f4915dcfa56a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65142025-01-09T01:09:13.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5440a0f-d385-4346-98d7-80199403546f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65152025-01-09T01:09:13.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5440a0f-d385-4346-98d7-80199403546f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65162025-01-09T01:09:13.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5440a0f-d385-4346-98d7-80199403546f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65172025-01-09T01:09:14.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = af6e5735-fa82-4c12-bad6-4cf3da8c119d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65182025-01-09T01:09:14.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = af6e5735-fa82-4c12-bad6-4cf3da8c119d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65192025-01-09T01:09:14.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = af6e5735-fa82-4c12-bad6-4cf3da8c119d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65202025-01-09T01:09:15.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a55d11e1-a47a-40fb-81d4-33ce7f8520db roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65212025-01-09T01:09:15.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a55d11e1-a47a-40fb-81d4-33ce7f8520db resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65222025-01-09T01:09:15.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a55d11e1-a47a-40fb-81d4-33ce7f8520db response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
65232025-01-09T01:09:16.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
65242025-01-09T01:09:16.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65252025-01-09T01:09:16.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
65262025-01-09T01:09:16.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65272025-01-09T01:09:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65282025-01-09T01:09:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65292025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
65302025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
65312025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65322025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65332025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
65342025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65352025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
65362025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65372025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
65382025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65392025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65402025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
65412025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
65422025-01-09T01:09:16.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65432025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65442025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65452025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
65462025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
65472025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
65482025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65492025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
65502025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65512025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65522025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
65532025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65542025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
65552025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65562025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
65572025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65582025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
65592025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65602025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65612025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65622025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65632025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65642025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65652025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65662025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65672025-01-09T01:09:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65682025-01-09T01:09:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65692025-01-09T01:09:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65702025-01-09T01:09:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65712025-01-09T01:09:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65722025-01-09T01:09:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65732025-01-09T01:09:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65742025-01-09T01:09:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1400, tv_nsec: 362778900 } })
65752025-01-09T01:09:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65762025-01-09T01:09:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1400, tv_nsec: 363278941 } })
65772025-01-09T01:09:16.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65782025-01-09T01:09:16.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65792025-01-09T01:09:16.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65802025-01-09T01:09:16.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812025-01-09T01:09:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.794429ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65822025-01-09T01:09:16.905ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65832025-01-09T01:09:16.905ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65842025-01-09T01:09:16.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65852025-01-09T01:09:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65862025-01-09T01:09:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65872025-01-09T01:09:16.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65882025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65892025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65902025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65912025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65922025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65932025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65942025-01-09T01:09:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65952025-01-09T01:09:16.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65962025-01-09T01:09:16.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65972025-01-09T01:09:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65982025-01-09T01:09:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65992025-01-09T01:09:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66002025-01-09T01:09:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66012025-01-09T01:09:16.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66022025-01-09T01:09:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66032025-01-09T01:09:16.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66042025-01-09T01:09:16.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66052025-01-09T01:09:16.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66062025-01-09T01:09:16.920ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1400, tv_nsec: 381180155 } })
66072025-01-09T01:09:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66082025-01-09T01:09:16.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
66092025-01-09T01:09:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66102025-01-09T01:09:16.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66112025-01-09T01:09:16.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66122025-01-09T01:09:16.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66132025-01-09T01:09:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66142025-01-09T01:09:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66152025-01-09T01:09:16.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66162025-01-09T01:09:16.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66172025-01-09T01:09:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66182025-01-09T01:09:16.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66192025-01-09T01:09:16.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202025-01-09T01:09:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
66212025-01-09T01:09:16.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66222025-01-09T01:09:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66232025-01-09T01:09:16.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.957127ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
66242025-01-09T01:09:16.948ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66252025-01-09T01:09:16.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66262025-01-09T01:09:16.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.242604ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
66272025-01-09T01:09:16.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66282025-01-09T01:09:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66292025-01-09T01:09:16.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66302025-01-09T01:09:16.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66312025-01-09T01:09:16.964ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66322025-01-09T01:09:16.964ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66332025-01-09T01:09:16.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66342025-01-09T01:09:16.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66352025-01-09T01:09:16.969ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66362025-01-09T01:09:16.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66372025-01-09T01:09:16.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66382025-01-09T01:09:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66392025-01-09T01:09:16.976ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66402025-01-09T01:09:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66412025-01-09T01:09:16.976ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66422025-01-09T01:09:16.976ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.707418ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66432025-01-09T01:09:16.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66442025-01-09T01:09:16.977ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66452025-01-09T01:09:16.978ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94fc7ad1-74b7-4eb0-bcb3-07ad3bf4cc5d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
66462025-01-09T01:09:16.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66472025-01-09T01:09:16.979ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66482025-01-09T01:09:16.980ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66492025-01-09T01:09:16.980ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66502025-01-09T01:09:16.980ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d65dc757-8e6e-4f76-95bf-331f2585c69c", "content-length": "26", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
66512025-01-09T01:09:16.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66522025-01-09T01:09:16.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66532025-01-09T01:09:17.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66542025-01-09T01:09:17.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66552025-01-09T01:09:17.032ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
66562025-01-09T01:09:17.032ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66572025-01-09T01:09:17.032ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b19c2f49-1b57-47f0-9b44-0e27d81e1fa4", "content-length": "26", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
66582025-01-09T01:09:17.032ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66592025-01-09T01:09:17.033ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66602025-01-09T01:09:17.033ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66612025-01-09T01:09:17.034ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
66622025-01-09T01:09:17.054ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.900573ms iteration = 14 status = {"physical_disks_added":0}
66632025-01-09T01:09:17.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
66642025-01-09T01:09:17.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 154.987077ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
66652025-01-09T01:09:17.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66662025-01-09T01:09:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66672025-01-09T01:09:17.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66682025-01-09T01:09:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66692025-01-09T01:09:17.072ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66702025-01-09T01:09:17.072ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66712025-01-09T01:09:17.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.065582ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66722025-01-09T01:09:17.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 172.383169ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66732025-01-09T01:09:17.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 84993b51-5277-448c-81a1-f4054728271c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
66742025-01-09T01:09:17.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 176.296607ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66752025-01-09T01:09:17.076ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9aa3ee8-625f-4890-9ca1-a38d8187e2e4", "content-length": "372", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
66762025-01-09T01:09:17.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66772025-01-09T01:09:17.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 84993b51-5277-448c-81a1-f4054728271c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
66782025-01-09T01:09:17.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66792025-01-09T01:09:17.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 84993b51-5277-448c-81a1-f4054728271c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
66802025-01-09T01:09:17.081ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66812025-01-09T01:09:17.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66822025-01-09T01:09:17.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 185.74175ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66832025-01-09T01:09:17.091ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 192.156476ms iteration = 12 status = {}
66842025-01-09T01:09:17.093ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66852025-01-09T01:09:17.093ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af190535-065b-415f-93c0-81e45c955115", "content-length": "1", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
66862025-01-09T01:09:17.095ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66872025-01-09T01:09:17.095ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66882025-01-09T01:09:17.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66892025-01-09T01:09:17.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66902025-01-09T01:09:17.097ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 197.978077ms iteration = 12 status = null
66912025-01-09T01:09:17.098ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "018eb210-3d5b-4bd5-ab47-501bdfb8828c", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
66922025-01-09T01:09:17.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66932025-01-09T01:09:17.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66942025-01-09T01:09:17.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66952025-01-09T01:09:17.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66962025-01-09T01:09:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66972025-01-09T01:09:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
66982025-01-09T01:09:17.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66992025-01-09T01:09:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67002025-01-09T01:09:17.103ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 203.412569ms iteration = 12 status = 0
67012025-01-09T01:09:17.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67022025-01-09T01:09:17.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67032025-01-09T01:09:17.106ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67042025-01-09T01:09:17.106ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67052025-01-09T01:09:17.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "083a5790-01d9-488d-b969-f93dfe3388b8", "date": "Thu, 09 Jan 2025 01:09:17 GMT"} })
67062025-01-09T01:09:17.109ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 208.552035ms iteration = 12 status = {}
67072025-01-09T01:09:17.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 211.400029ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67082025-01-09T01:09:17.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67092025-01-09T01:09:17.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67102025-01-09T01:09:17.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67112025-01-09T01:09:17.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67122025-01-09T01:09:17.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67132025-01-09T01:09:17.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67142025-01-09T01:09:17.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67152025-01-09T01:09:17.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67162025-01-09T01:09:17.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67172025-01-09T01:09:17.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67182025-01-09T01:09:17.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67192025-01-09T01:09:17.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67202025-01-09T01:09:17.185ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
67212025-01-09T01:09:17.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67222025-01-09T01:09:17.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67232025-01-09T01:09:17.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67242025-01-09T01:09:17.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "690acfce-bbdc-4e21-b7b4-9f820ea8a3c7", "content-length": "134", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
67252025-01-09T01:09:17.195ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67262025-01-09T01:09:17.195ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
67272025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67282025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67292025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67302025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67312025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67322025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67332025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67342025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67352025-01-09T01:09:17.196ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
67362025-01-09T01:09:17.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67372025-01-09T01:09:17.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67382025-01-09T01:09:17.198ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67392025-01-09T01:09:17.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67402025-01-09T01:09:17.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d331375-8382-46e4-84df-197c20eeef88", "content-length": "2", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
67412025-01-09T01:09:17.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67422025-01-09T01:09:17.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f5f5703-5146-4350-9fde-c39b70525779", "content-length": "52", "date": "Thu, 09 Jan 2025 01:09:16 GMT"} })
67432025-01-09T01:09:17.199ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
67442025-01-09T01:09:17.199ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67452025-01-09T01:09:17.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ba2437c-9e5f-419e-8290-c94a0d20136b", "content-length": "691", "date": "Thu, 09 Jan 2025 01:09:17 GMT"} })
67462025-01-09T01:09:17.199ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
67472025-01-09T01:09:17.199ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
67482025-01-09T01:09:17.199ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
67492025-01-09T01:09:17.201ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.870719ms iteration = 12 status = {}
67502025-01-09T01:09:17.290ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "33ad5b7c-70d7-4d23-ba17-700a96b46b04", "date": "Thu, 09 Jan 2025 01:09:17 GMT"} })
67512025-01-09T01:09:17.290ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
67522025-01-09T01:09:17.290ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67532025-01-09T01:09:17.291ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe0451d3-770f-4f07-9d37-7f34269f9841", "content-length": "682", "date": "Thu, 09 Jan 2025 01:09:17 GMT"} })
67542025-01-09T01:09:17.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67552025-01-09T01:09:17.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67562025-01-09T01:09:17.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67572025-01-09T01:09:17.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67582025-01-09T01:09:17.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67592025-01-09T01:09:17.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67602025-01-09T01:09:17.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67612025-01-09T01:09:17.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67622025-01-09T01:09:17.306ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 405.923448ms iteration = 12 status = {}
67632025-01-09T01:09:18.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9abff52a-d37e-4c10-bfcd-ad56d127d09c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67642025-01-09T01:09:18.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9abff52a-d37e-4c10-bfcd-ad56d127d09c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67652025-01-09T01:09:18.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9abff52a-d37e-4c10-bfcd-ad56d127d09c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67662025-01-09T01:09:19.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fac50076-0063-4886-aef7-b2aa78937832 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67672025-01-09T01:09:19.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fac50076-0063-4886-aef7-b2aa78937832 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67682025-01-09T01:09:19.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fac50076-0063-4886-aef7-b2aa78937832 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67692025-01-09T01:09:19.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 1a8b7c15-a31c-42a3-a6b2-6be5a5055a26 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
67702025-01-09T01:09:20.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca2222f8-fbca-4072-adb6-f50bfa3d7c6b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67712025-01-09T01:09:20.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca2222f8-fbca-4072-adb6-f50bfa3d7c6b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67722025-01-09T01:09:20.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ca2222f8-fbca-4072-adb6-f50bfa3d7c6b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67732025-01-09T01:09:21.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 79f6c581-23a2-4ba9-a5f7-7b270ca6b749 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67742025-01-09T01:09:21.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 79f6c581-23a2-4ba9-a5f7-7b270ca6b749 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67752025-01-09T01:09:21.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 79f6c581-23a2-4ba9-a5f7-7b270ca6b749 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67762025-01-09T01:09:22.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6e476fda-979b-4c23-94cb-3c3d91f3636f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67772025-01-09T01:09:22.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6e476fda-979b-4c23-94cb-3c3d91f3636f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67782025-01-09T01:09:22.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6e476fda-979b-4c23-94cb-3c3d91f3636f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67792025-01-09T01:09:23.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 23c33f94-d1e5-4593-8449-c4412fbc0c45 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67802025-01-09T01:09:23.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 23c33f94-d1e5-4593-8449-c4412fbc0c45 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67812025-01-09T01:09:23.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 23c33f94-d1e5-4593-8449-c4412fbc0c45 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67822025-01-09T01:09:24.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a5ddc585-8380-448a-97be-1f2e62f86b8e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67832025-01-09T01:09:24.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a5ddc585-8380-448a-97be-1f2e62f86b8e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67842025-01-09T01:09:24.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a5ddc585-8380-448a-97be-1f2e62f86b8e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67852025-01-09T01:09:25.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c0d92b7c-2980-40b7-afa0-373459a5e552 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67862025-01-09T01:09:25.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c0d92b7c-2980-40b7-afa0-373459a5e552 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67872025-01-09T01:09:25.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c0d92b7c-2980-40b7-afa0-373459a5e552 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67882025-01-09T01:09:26.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 683f7896-ddc7-4422-9488-ba945935601c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67892025-01-09T01:09:26.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 683f7896-ddc7-4422-9488-ba945935601c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67902025-01-09T01:09:26.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 683f7896-ddc7-4422-9488-ba945935601c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
67912025-01-09T01:09:26.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
67922025-01-09T01:09:26.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
67932025-01-09T01:09:26.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67942025-01-09T01:09:26.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67952025-01-09T01:09:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67962025-01-09T01:09:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67972025-01-09T01:09:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67982025-01-09T01:09:26.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67992025-01-09T01:09:26.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002025-01-09T01:09:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68012025-01-09T01:09:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68022025-01-09T01:09:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68032025-01-09T01:09:26.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68042025-01-09T01:09:26.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68052025-01-09T01:09:26.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062025-01-09T01:09:26.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
68072025-01-09T01:09:26.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68082025-01-09T01:09:26.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68092025-01-09T01:09:26.954ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
68102025-01-09T01:09:26.954ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.098341ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
68112025-01-09T01:09:26.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.538591ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68122025-01-09T01:09:27.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7707f93a-bff5-4daa-ae7d-2b586b9a491c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68132025-01-09T01:09:27.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7707f93a-bff5-4daa-ae7d-2b586b9a491c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68142025-01-09T01:09:27.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7707f93a-bff5-4daa-ae7d-2b586b9a491c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68152025-01-09T01:09:28.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0ac61294-ab2c-4482-822f-2e9ef7f67902 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68162025-01-09T01:09:28.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0ac61294-ab2c-4482-822f-2e9ef7f67902 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68172025-01-09T01:09:28.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0ac61294-ab2c-4482-822f-2e9ef7f67902 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68182025-01-09T01:09:29.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9800e88-f020-4a48-b0ff-3faf46f57dce roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68192025-01-09T01:09:29.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9800e88-f020-4a48-b0ff-3faf46f57dce resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68202025-01-09T01:09:29.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9800e88-f020-4a48-b0ff-3faf46f57dce response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68212025-01-09T01:09:29.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = aa78b1ef-f415-4bdb-af86-6366b15138d4 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
68222025-01-09T01:09:30.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c7ec4b2-3baf-4208-8d64-dc9d7aa0ad69 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68232025-01-09T01:09:30.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c7ec4b2-3baf-4208-8d64-dc9d7aa0ad69 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68242025-01-09T01:09:30.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c7ec4b2-3baf-4208-8d64-dc9d7aa0ad69 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68252025-01-09T01:09:31.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c4c00961-3f69-4b96-abce-083b89bd37e9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68262025-01-09T01:09:31.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c4c00961-3f69-4b96-abce-083b89bd37e9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68272025-01-09T01:09:31.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c4c00961-3f69-4b96-abce-083b89bd37e9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68282025-01-09T01:09:32.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82c722b1-0d07-46f9-b61e-3aeb30da10c9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68292025-01-09T01:09:32.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82c722b1-0d07-46f9-b61e-3aeb30da10c9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68302025-01-09T01:09:32.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82c722b1-0d07-46f9-b61e-3aeb30da10c9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68312025-01-09T01:09:33.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 246f2673-33f8-4470-a5cf-48426f1072e6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68322025-01-09T01:09:33.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 246f2673-33f8-4470-a5cf-48426f1072e6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68332025-01-09T01:09:33.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 246f2673-33f8-4470-a5cf-48426f1072e6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68342025-01-09T01:09:34.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c9c7ba51-840b-42f5-b23c-86177165f46a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68352025-01-09T01:09:34.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c9c7ba51-840b-42f5-b23c-86177165f46a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68362025-01-09T01:09:34.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c9c7ba51-840b-42f5-b23c-86177165f46a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68372025-01-09T01:09:35.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 13962705-cdb7-4401-89ad-71f3869609f3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68382025-01-09T01:09:35.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 13962705-cdb7-4401-89ad-71f3869609f3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68392025-01-09T01:09:35.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 13962705-cdb7-4401-89ad-71f3869609f3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68402025-01-09T01:09:36.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e9308360-5ff2-4f0d-9171-069516ea2946 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68412025-01-09T01:09:36.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e9308360-5ff2-4f0d-9171-069516ea2946 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68422025-01-09T01:09:36.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e9308360-5ff2-4f0d-9171-069516ea2946 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68432025-01-09T01:09:36.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
68442025-01-09T01:09:36.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
68452025-01-09T01:09:36.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68462025-01-09T01:09:36.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68472025-01-09T01:09:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68482025-01-09T01:09:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68492025-01-09T01:09:36.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68502025-01-09T01:09:36.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68512025-01-09T01:09:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68522025-01-09T01:09:36.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.182054ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68532025-01-09T01:09:36.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68542025-01-09T01:09:36.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68552025-01-09T01:09:36.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68562025-01-09T01:09:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68572025-01-09T01:09:36.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68582025-01-09T01:09:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68592025-01-09T01:09:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
68602025-01-09T01:09:36.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68612025-01-09T01:09:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68622025-01-09T01:09:36.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
68632025-01-09T01:09:36.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.411375ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
68642025-01-09T01:09:37.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1c55807f-a120-4d7d-a35b-7b20161ac37d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68652025-01-09T01:09:37.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1c55807f-a120-4d7d-a35b-7b20161ac37d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68662025-01-09T01:09:37.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1c55807f-a120-4d7d-a35b-7b20161ac37d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68672025-01-09T01:09:38.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cf374d3-09e0-4ccc-8274-ccae83d9487d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68682025-01-09T01:09:38.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cf374d3-09e0-4ccc-8274-ccae83d9487d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68692025-01-09T01:09:38.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cf374d3-09e0-4ccc-8274-ccae83d9487d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68702025-01-09T01:09:39.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d069313a-74f5-4bfb-b50e-9fe181fa1cfb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68712025-01-09T01:09:39.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d069313a-74f5-4bfb-b50e-9fe181fa1cfb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68722025-01-09T01:09:39.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d069313a-74f5-4bfb-b50e-9fe181fa1cfb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68732025-01-09T01:09:39.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = f13d0796-e1e4-480d-8878-fdc7b36b05d2 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
68742025-01-09T01:09:40.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6c147043-bb02-43ae-9dfb-cf0c7bbdf3e7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68752025-01-09T01:09:40.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6c147043-bb02-43ae-9dfb-cf0c7bbdf3e7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68762025-01-09T01:09:40.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6c147043-bb02-43ae-9dfb-cf0c7bbdf3e7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68772025-01-09T01:09:41.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 07b2fb5a-479c-4650-abc6-90c1d39af4c0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68782025-01-09T01:09:41.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 07b2fb5a-479c-4650-abc6-90c1d39af4c0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68792025-01-09T01:09:41.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 07b2fb5a-479c-4650-abc6-90c1d39af4c0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68802025-01-09T01:09:42.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8e4830c-a32e-4039-b976-44b6dc617fcf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68812025-01-09T01:09:42.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8e4830c-a32e-4039-b976-44b6dc617fcf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68822025-01-09T01:09:42.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b8e4830c-a32e-4039-b976-44b6dc617fcf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68832025-01-09T01:09:43.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 61d878a4-7da8-4f6e-8bea-f4b29818e8dd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68842025-01-09T01:09:43.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 61d878a4-7da8-4f6e-8bea-f4b29818e8dd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68852025-01-09T01:09:43.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 61d878a4-7da8-4f6e-8bea-f4b29818e8dd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68862025-01-09T01:09:44.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bdca2f90-e3c7-4c63-9506-f7414d791c8a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68872025-01-09T01:09:44.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bdca2f90-e3c7-4c63-9506-f7414d791c8a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68882025-01-09T01:09:44.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bdca2f90-e3c7-4c63-9506-f7414d791c8a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68892025-01-09T01:09:45.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 17375cc5-b5fd-49ae-bd46-c7b02f88b7eb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68902025-01-09T01:09:45.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 17375cc5-b5fd-49ae-bd46-c7b02f88b7eb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68912025-01-09T01:09:45.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 17375cc5-b5fd-49ae-bd46-c7b02f88b7eb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68922025-01-09T01:09:46.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b31e282-eaf4-4587-a6ff-a218738fec4f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68932025-01-09T01:09:46.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b31e282-eaf4-4587-a6ff-a218738fec4f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68942025-01-09T01:09:46.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b31e282-eaf4-4587-a6ff-a218738fec4f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
68952025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
68962025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68972025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
68982025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68992025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
69002025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69012025-01-09T01:09:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 00:59:46.899634718 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69022025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69032025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
69042025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
69052025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69062025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69072025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
69082025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
69092025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
69102025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
69112025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
69122025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69132025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69142025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
69152025-01-09T01:09:46.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69162025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
69172025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
69182025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69192025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69202025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69212025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
69222025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
69232025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69242025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69252025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69262025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
69272025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
69282025-01-09T01:09:46.899ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69292025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69302025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
69312025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69322025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
69332025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69342025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
69352025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69362025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
69372025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69382025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
69392025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69402025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
69412025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69422025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
69432025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69442025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
69452025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
69462025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69472025-01-09T01:09:46.900ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69482025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69492025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
69502025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69512025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
69522025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
69532025-01-09T01:09:46.900ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
69542025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.57\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
69552025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
69562025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
69572025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69582025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69592025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69602025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69612025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69622025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69632025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69642025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69652025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69662025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69672025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69682025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69692025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69702025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69712025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69722025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69732025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69742025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69752025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69762025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69772025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69782025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69792025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69802025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69812025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69822025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69832025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69842025-01-09T01:09:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69852025-01-09T01:09:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 361175747 } })
69862025-01-09T01:09:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 361192908 } })
69872025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69882025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69892025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69902025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69912025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69922025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.670138ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69932025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
69942025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.718509ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
69952025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69962025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69972025-01-09T01:09:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69982025-01-09T01:09:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69992025-01-09T01:09:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70002025-01-09T01:09:46.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70012025-01-09T01:09:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70022025-01-09T01:09:46.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 364931772 } })
70032025-01-09T01:09:46.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
70042025-01-09T01:09:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.965583ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70052025-01-09T01:09:46.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 00:59:46.899634718 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70062025-01-09T01:09:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.284282ms iteration = 7 status = {"expiration":"2025-01-09T00:59:46.899634718Z","pruned":[]}
70072025-01-09T01:09:46.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70082025-01-09T01:09:46.908ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 368643656 } })
70092025-01-09T01:09:46.908ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
70102025-01-09T01:09:46.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70112025-01-09T01:09:46.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70122025-01-09T01:09:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70132025-01-09T01:09:46.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70142025-01-09T01:09:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70152025-01-09T01:09:46.912ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.586444ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
70162025-01-09T01:09:46.914ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70172025-01-09T01:09:46.914ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70182025-01-09T01:09:46.914ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.619949ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70192025-01-09T01:09:46.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70202025-01-09T01:09:46.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212025-01-09T01:09:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70222025-01-09T01:09:46.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70232025-01-09T01:09:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70242025-01-09T01:09:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70252025-01-09T01:09:46.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70262025-01-09T01:09:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70272025-01-09T01:09:46.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70282025-01-09T01:09:46.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70292025-01-09T01:09:46.926ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70302025-01-09T01:09:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70312025-01-09T01:09:46.928ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70322025-01-09T01:09:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70332025-01-09T01:09:46.942ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70342025-01-09T01:09:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70352025-01-09T01:09:46.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70362025-01-09T01:09:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70372025-01-09T01:09:46.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70382025-01-09T01:09:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70392025-01-09T01:09:46.948ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70402025-01-09T01:09:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70412025-01-09T01:09:46.958ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70422025-01-09T01:09:46.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70432025-01-09T01:09:46.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.212031ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70442025-01-09T01:09:46.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70452025-01-09T01:09:46.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70462025-01-09T01:09:46.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70472025-01-09T01:09:46.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70482025-01-09T01:09:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70492025-01-09T01:09:46.966ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502025-01-09T01:09:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70512025-01-09T01:09:46.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70522025-01-09T01:09:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70532025-01-09T01:09:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70542025-01-09T01:09:46.970ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70552025-01-09T01:09:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70562025-01-09T01:09:46.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70572025-01-09T01:09:46.975ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70582025-01-09T01:09:46.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70592025-01-09T01:09:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70602025-01-09T01:09:46.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70612025-01-09T01:09:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70622025-01-09T01:09:46.979ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70632025-01-09T01:09:46.981ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70642025-01-09T01:09:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70652025-01-09T01:09:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70662025-01-09T01:09:46.982ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70672025-01-09T01:09:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70682025-01-09T01:09:46.985ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70692025-01-09T01:09:46.985ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70702025-01-09T01:09:46.985ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70712025-01-09T01:09:46.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70722025-01-09T01:09:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70732025-01-09T01:09:46.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.98039ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
70742025-01-09T01:09:46.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70752025-01-09T01:09:46.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70762025-01-09T01:09:46.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70772025-01-09T01:09:46.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 88.883856ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
70782025-01-09T01:09:46.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70792025-01-09T01:09:46.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70802025-01-09T01:09:46.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.904854ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70812025-01-09T01:09:46.993ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70822025-01-09T01:09:46.993ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70832025-01-09T01:09:46.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70842025-01-09T01:09:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70852025-01-09T01:09:46.996ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 456689092 } })
70862025-01-09T01:09:46.996ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
70872025-01-09T01:09:46.998ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70882025-01-09T01:09:46.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70892025-01-09T01:09:46.999ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70902025-01-09T01:09:46.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70912025-01-09T01:09:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70922025-01-09T01:09:47.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70932025-01-09T01:09:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70942025-01-09T01:09:47.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70952025-01-09T01:09:47.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70962025-01-09T01:09:47.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70972025-01-09T01:09:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70982025-01-09T01:09:47.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.911104ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70992025-01-09T01:09:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71002025-01-09T01:09:47.003ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71012025-01-09T01:09:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71022025-01-09T01:09:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71032025-01-09T01:09:47.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71042025-01-09T01:09:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71052025-01-09T01:09:47.006ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71062025-01-09T01:09:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71072025-01-09T01:09:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71082025-01-09T01:09:47.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71092025-01-09T01:09:47.014ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 114.239458ms iteration = 4 status = {"nsuccess":5}
71102025-01-09T01:09:47.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71112025-01-09T01:09:47.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71122025-01-09T01:09:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71132025-01-09T01:09:47.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71142025-01-09T01:09:47.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71152025-01-09T01:09:47.028ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71162025-01-09T01:09:47.028ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71172025-01-09T01:09:47.028ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71182025-01-09T01:09:47.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71192025-01-09T01:09:47.029ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e12a2989-55e3-4b5c-9f8d-1fb11e0ce81e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
71202025-01-09T01:09:47.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71212025-01-09T01:09:47.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71222025-01-09T01:09:47.031ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71232025-01-09T01:09:47.031ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71242025-01-09T01:09:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71252025-01-09T01:09:47.031ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1677b8d7-6c93-429d-86db-39aed646b105", "content-length": "26", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
71262025-01-09T01:09:47.031ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71272025-01-09T01:09:47.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71282025-01-09T01:09:47.032ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71292025-01-09T01:09:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71302025-01-09T01:09:47.034ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71312025-01-09T01:09:47.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71322025-01-09T01:09:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
71332025-01-09T01:09:47.046ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71342025-01-09T01:09:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71352025-01-09T01:09:47.047ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71362025-01-09T01:09:47.047ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71372025-01-09T01:09:47.047ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71382025-01-09T01:09:47.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71392025-01-09T01:09:47.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71402025-01-09T01:09:47.048ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71412025-01-09T01:09:47.048ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 148.413568ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71422025-01-09T01:09:47.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71432025-01-09T01:09:47.048ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 148.715835ms iteration = 13 status = 0
71442025-01-09T01:09:47.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71452025-01-09T01:09:47.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71462025-01-09T01:09:47.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71472025-01-09T01:09:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71482025-01-09T01:09:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71492025-01-09T01:09:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71502025-01-09T01:09:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71512025-01-09T01:09:47.055ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71522025-01-09T01:09:47.055ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71532025-01-09T01:09:47.055ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71542025-01-09T01:09:47.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71552025-01-09T01:09:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71562025-01-09T01:09:47.056ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71572025-01-09T01:09:47.056ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
71582025-01-09T01:09:47.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71592025-01-09T01:09:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71602025-01-09T01:09:47.059ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71612025-01-09T01:09:47.059ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71622025-01-09T01:09:47.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.376356ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71632025-01-09T01:09:47.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71642025-01-09T01:09:47.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71652025-01-09T01:09:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71662025-01-09T01:09:47.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71672025-01-09T01:09:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71682025-01-09T01:09:47.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71692025-01-09T01:09:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71702025-01-09T01:09:47.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71712025-01-09T01:09:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71722025-01-09T01:09:47.067ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
71732025-01-09T01:09:47.067ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71742025-01-09T01:09:47.067ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
71752025-01-09T01:09:47.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 167.897928ms iteration = 7 status = {"generation":2}
71762025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71772025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71782025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71792025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71802025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
71812025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71822025-01-09T01:09:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71832025-01-09T01:09:47.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71842025-01-09T01:09:47.071ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71852025-01-09T01:09:47.071ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71862025-01-09T01:09:47.071ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 171.603152ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71872025-01-09T01:09:47.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71882025-01-09T01:09:47.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71892025-01-09T01:09:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71902025-01-09T01:09:47.075ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71912025-01-09T01:09:47.075ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71922025-01-09T01:09:47.075ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
71932025-01-09T01:09:47.075ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 175.881538ms iteration = 7 status = {"generation":1}
71942025-01-09T01:09:47.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
71952025-01-09T01:09:47.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 179.857848ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
71962025-01-09T01:09:47.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71972025-01-09T01:09:47.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71982025-01-09T01:09:47.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 187.252334ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71992025-01-09T01:09:47.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72002025-01-09T01:09:47.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72012025-01-09T01:09:47.103ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72022025-01-09T01:09:47.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72032025-01-09T01:09:47.122ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
72042025-01-09T01:09:47.122ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72052025-01-09T01:09:47.122ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "334eba73-c599-4d40-a4dd-17b90d1e148a", "content-length": "26", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
72062025-01-09T01:09:47.122ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72072025-01-09T01:09:47.124ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
72082025-01-09T01:09:47.141ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.881738ms iteration = 15 status = {"physical_disks_added":0}
72092025-01-09T01:09:47.146ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
72102025-01-09T01:09:47.146ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 247.018913ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72112025-01-09T01:09:47.161ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72122025-01-09T01:09:47.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 261.532531ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72132025-01-09T01:09:47.175ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72142025-01-09T01:09:47.175ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e72f2ae1-6393-4dac-99a4-61f149217251", "content-length": "1", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
72152025-01-09T01:09:47.177ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72162025-01-09T01:09:47.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72172025-01-09T01:09:47.179ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 279.569088ms iteration = 13 status = null
72182025-01-09T01:09:47.188ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72192025-01-09T01:09:47.188ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1c87f928-76b5-4cd9-ad77-e4a79e72adda", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72202025-01-09T01:09:47.188ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72212025-01-09T01:09:47.190ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ffd4f23-5793-4a44-b1c1-dac86cb981d0", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72222025-01-09T01:09:47.190ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72232025-01-09T01:09:47.192ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72242025-01-09T01:09:47.192ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 293.162364ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72252025-01-09T01:09:47.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72262025-01-09T01:09:47.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72272025-01-09T01:09:47.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72282025-01-09T01:09:47.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72292025-01-09T01:09:47.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72302025-01-09T01:09:47.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72312025-01-09T01:09:47.252ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72322025-01-09T01:09:47.252ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72332025-01-09T01:09:47.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342025-01-09T01:09:47.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72352025-01-09T01:09:47.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72362025-01-09T01:09:47.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72372025-01-09T01:09:47.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72382025-01-09T01:09:47.276ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa3fa52f-07e1-4b4a-a79a-60d978832357", "content-length": "372", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} })
72392025-01-09T01:09:47.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72402025-01-09T01:09:47.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72412025-01-09T01:09:47.278ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 378.5029ms iteration = 13 status = {}
72422025-01-09T01:09:47.317ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
72432025-01-09T01:09:47.317ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72442025-01-09T01:09:47.322ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "567a5672-659c-4ecd-bbc1-07b1cac7ebb4", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} })
72452025-01-09T01:09:47.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72462025-01-09T01:09:47.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72472025-01-09T01:09:47.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72482025-01-09T01:09:47.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72492025-01-09T01:09:47.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72502025-01-09T01:09:47.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72512025-01-09T01:09:47.331ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72522025-01-09T01:09:47.331ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72532025-01-09T01:09:47.336ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "85096eb4-7419-4a89-a7c6-059975d2ab6e", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} })
72542025-01-09T01:09:47.338ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 438.236308ms iteration = 13 status = {}
72552025-01-09T01:09:47.338ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72562025-01-09T01:09:47.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c2c119e-d97a-4ac1-bcd0-c7f3d055675d", "content-length": "691", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} })
72572025-01-09T01:09:47.339ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72582025-01-09T01:09:47.339ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72592025-01-09T01:09:47.339ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72602025-01-09T01:09:47.340ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 440.628122ms iteration = 13 status = {}
72612025-01-09T01:09:47.348ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72622025-01-09T01:09:47.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "53469e40-0553-46f9-a65b-da03be5ac5eb", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72632025-01-09T01:09:47.348ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72642025-01-09T01:09:47.350ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6257462b-2ea9-41b8-a80f-fd09a2de52f6", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72652025-01-09T01:09:47.350ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72662025-01-09T01:09:47.351ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "12af4c39-a562-4bf1-bbe6-e26313c538ce", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72672025-01-09T01:09:47.351ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72682025-01-09T01:09:47.353ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
72692025-01-09T01:09:47.353ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 453.403948ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72702025-01-09T01:09:47.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72712025-01-09T01:09:47.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72722025-01-09T01:09:47.380ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
72732025-01-09T01:09:47.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72742025-01-09T01:09:47.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72752025-01-09T01:09:47.389ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72762025-01-09T01:09:47.389ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "50c94ec6-15d3-43ac-a65c-0680c958b2cf", "content-length": "134", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
72772025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72782025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
72792025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72802025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72812025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72822025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72832025-01-09T01:09:47.389ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72842025-01-09T01:09:47.390ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72852025-01-09T01:09:47.390ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72862025-01-09T01:09:47.390ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72872025-01-09T01:09:47.390ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
72882025-01-09T01:09:47.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72892025-01-09T01:09:47.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72902025-01-09T01:09:47.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72912025-01-09T01:09:47.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1586b8d3-6b12-47c4-9d33-4092c8049727", "content-length": "2", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
72922025-01-09T01:09:47.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72932025-01-09T01:09:47.393ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3493f0e-6223-4edb-8a38-89417cbf7552", "content-length": "52", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
72942025-01-09T01:09:47.393ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
72952025-01-09T01:09:47.393ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72962025-01-09T01:09:47.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "909540b8-4dcb-48a4-a645-582856928afa", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
72972025-01-09T01:09:47.489ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
72982025-01-09T01:09:47.489ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72992025-01-09T01:09:47.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8ad2337-2c33-42e7-aa41-b3d54d018a0c", "content-length": "682", "date": "Thu, 09 Jan 2025 01:09:46 GMT"} })
73002025-01-09T01:09:47.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73012025-01-09T01:09:47.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73022025-01-09T01:09:47.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73032025-01-09T01:09:47.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73042025-01-09T01:09:47.496ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
73052025-01-09T01:09:47.496ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
73062025-01-09T01:09:47.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73072025-01-09T01:09:47.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73082025-01-09T01:09:47.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73092025-01-09T01:09:47.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73102025-01-09T01:09:47.507ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 607.662639ms iteration = 13 status = {}
73112025-01-09T01:09:47.526ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
73122025-01-09T01:09:47.526ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:37364
73132025-01-09T01:09:47.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37364 req_id = 2501ef6a-44c6-4ad6-b574-4359f843ba35 roles = RoleSet { roles: {} } uri = /metrics/producers
73142025-01-09T01:09:47.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37364 req_id = 2501ef6a-44c6-4ad6-b574-4359f843ba35 resource = Database result = Ok(()) uri = /metrics/producers
73152025-01-09T01:09:47.570ZINFOnexus: assigned collector to new producer collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 file = nexus/src/app/oximeter.rs:76 producer_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
73162025-01-09T01:09:47.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43442 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37364 req_id = 2501ef6a-44c6-4ad6-b574-4359f843ba35 response_code = 201 uri = /metrics/producers
73172025-01-09T01:09:47.570ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2501ef6a-44c6-4ad6-b574-4359f843ba35", "content-length": "41", "date": "Thu, 09 Jan 2025 01:09:47 GMT"} })
73182025-01-09T01:09:47.571ZDEBGnexus (producer-registration-task): registered with nexus successfully
73192025-01-09T01:09:47.571ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73202025-01-09T01:09:47.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49cdfa8a-b3c1-4de5-8e26-46b7eb2d8345 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73212025-01-09T01:09:47.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49cdfa8a-b3c1-4de5-8e26-46b7eb2d8345 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73222025-01-09T01:09:47.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49cdfa8a-b3c1-4de5-8e26-46b7eb2d8345 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73232025-01-09T01:09:48.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a85abaab-4b0a-414b-95a8-81eb0aa08c23 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73242025-01-09T01:09:48.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a85abaab-4b0a-414b-95a8-81eb0aa08c23 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73252025-01-09T01:09:48.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a85abaab-4b0a-414b-95a8-81eb0aa08c23 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73262025-01-09T01:09:49.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d83fdf0e-69b3-46ed-9766-3a420be17912 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73272025-01-09T01:09:49.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d83fdf0e-69b3-46ed-9766-3a420be17912 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73282025-01-09T01:09:49.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d83fdf0e-69b3-46ed-9766-3a420be17912 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73292025-01-09T01:09:49.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 56d5af93-29aa-4702-bd74-35dc21796ccb response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
73302025-01-09T01:09:50.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0c5dcfa4-42c3-4cde-a993-53da940b954e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73312025-01-09T01:09:50.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0c5dcfa4-42c3-4cde-a993-53da940b954e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73322025-01-09T01:09:50.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0c5dcfa4-42c3-4cde-a993-53da940b954e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73332025-01-09T01:09:51.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c05fa719-32d2-49d2-8aac-75313e70d219 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73342025-01-09T01:09:51.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c05fa719-32d2-49d2-8aac-75313e70d219 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73352025-01-09T01:09:51.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c05fa719-32d2-49d2-8aac-75313e70d219 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73362025-01-09T01:09:52.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5e1609e-dd4e-4a28-afea-295d82240e41 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73372025-01-09T01:09:52.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5e1609e-dd4e-4a28-afea-295d82240e41 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73382025-01-09T01:09:52.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5e1609e-dd4e-4a28-afea-295d82240e41 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73392025-01-09T01:09:53.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f35f107-3bdc-46e2-ac87-4d50fd6597ad roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73402025-01-09T01:09:53.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f35f107-3bdc-46e2-ac87-4d50fd6597ad resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73412025-01-09T01:09:53.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f35f107-3bdc-46e2-ac87-4d50fd6597ad response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73422025-01-09T01:09:54.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c3a90e1-0bbe-4060-9b40-3b3108b80139 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73432025-01-09T01:09:54.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c3a90e1-0bbe-4060-9b40-3b3108b80139 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73442025-01-09T01:09:54.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c3a90e1-0bbe-4060-9b40-3b3108b80139 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73452025-01-09T01:09:55.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2430d410-1fa0-4f6c-b977-b2009d565105 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73462025-01-09T01:09:55.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2430d410-1fa0-4f6c-b977-b2009d565105 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73472025-01-09T01:09:55.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2430d410-1fa0-4f6c-b977-b2009d565105 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73482025-01-09T01:09:56.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
73492025-01-09T01:09:56.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73502025-01-09T01:09:56.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
73512025-01-09T01:09:56.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73522025-01-09T01:09:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73532025-01-09T01:09:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73542025-01-09T01:09:56.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73552025-01-09T01:09:56.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73562025-01-09T01:09:56.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73572025-01-09T01:09:56.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.430669ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73582025-01-09T01:09:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73592025-01-09T01:09:56.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73602025-01-09T01:09:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73612025-01-09T01:09:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73622025-01-09T01:09:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73632025-01-09T01:09:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73642025-01-09T01:09:56.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
73652025-01-09T01:09:56.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73662025-01-09T01:09:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73672025-01-09T01:09:56.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
73682025-01-09T01:09:56.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.382347ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
73692025-01-09T01:09:56.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f69d11e2-6485-44e8-949f-4749ec3a6573 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73702025-01-09T01:09:56.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f69d11e2-6485-44e8-949f-4749ec3a6573 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73712025-01-09T01:09:56.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f69d11e2-6485-44e8-949f-4749ec3a6573 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73722025-01-09T01:09:58.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 77921da4-d00e-4fa3-9fc3-8201c773a8ff roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73732025-01-09T01:09:58.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 77921da4-d00e-4fa3-9fc3-8201c773a8ff resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73742025-01-09T01:09:58.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 77921da4-d00e-4fa3-9fc3-8201c773a8ff response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73752025-01-09T01:09:59.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d286fa78-cd4a-4d3b-b760-ce1c3365146f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73762025-01-09T01:09:59.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d286fa78-cd4a-4d3b-b760-ce1c3365146f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73772025-01-09T01:09:59.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d286fa78-cd4a-4d3b-b760-ce1c3365146f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73782025-01-09T01:09:59.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 7b6d9c02-d309-4595-a5b2-c0eca42fb033 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
73792025-01-09T01:10:00.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 48c05f03-53fc-47a1-a69f-b4ba376f9f15 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73802025-01-09T01:10:00.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 48c05f03-53fc-47a1-a69f-b4ba376f9f15 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73812025-01-09T01:10:00.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 48c05f03-53fc-47a1-a69f-b4ba376f9f15 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73822025-01-09T01:10:01.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d9c6737-a728-4117-bf55-695e7cb88992 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73832025-01-09T01:10:01.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d9c6737-a728-4117-bf55-695e7cb88992 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73842025-01-09T01:10:01.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9d9c6737-a728-4117-bf55-695e7cb88992 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73852025-01-09T01:10:02.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2345b85-3e4c-4c39-948f-bb39ce93862b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73862025-01-09T01:10:02.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2345b85-3e4c-4c39-948f-bb39ce93862b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73872025-01-09T01:10:02.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2345b85-3e4c-4c39-948f-bb39ce93862b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73882025-01-09T01:10:03.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce33b390-7500-42b7-b72e-ab41baf7837f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73892025-01-09T01:10:03.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce33b390-7500-42b7-b72e-ab41baf7837f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73902025-01-09T01:10:03.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ce33b390-7500-42b7-b72e-ab41baf7837f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73912025-01-09T01:10:04.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a742871d-c237-4e84-b930-5829d28c89da roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73922025-01-09T01:10:04.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a742871d-c237-4e84-b930-5829d28c89da resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73932025-01-09T01:10:04.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a742871d-c237-4e84-b930-5829d28c89da response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73942025-01-09T01:10:05.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2c65bb53-cb9c-47c0-ad17-016fb5f6f411 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73952025-01-09T01:10:05.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2c65bb53-cb9c-47c0-ad17-016fb5f6f411 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73962025-01-09T01:10:05.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2c65bb53-cb9c-47c0-ad17-016fb5f6f411 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73972025-01-09T01:10:06.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3716f43-0c5c-4d5a-a317-db9a1fc47335 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73982025-01-09T01:10:06.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3716f43-0c5c-4d5a-a317-db9a1fc47335 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
73992025-01-09T01:10:06.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e3716f43-0c5c-4d5a-a317-db9a1fc47335 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74002025-01-09T01:10:06.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
74012025-01-09T01:10:06.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
74022025-01-09T01:10:06.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74032025-01-09T01:10:06.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74042025-01-09T01:10:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74052025-01-09T01:10:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74062025-01-09T01:10:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74072025-01-09T01:10:06.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74082025-01-09T01:10:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74092025-01-09T01:10:06.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.41642ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74102025-01-09T01:10:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74112025-01-09T01:10:06.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74122025-01-09T01:10:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74132025-01-09T01:10:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74142025-01-09T01:10:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74152025-01-09T01:10:06.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74162025-01-09T01:10:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
74172025-01-09T01:10:06.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74182025-01-09T01:10:06.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74192025-01-09T01:10:06.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
74202025-01-09T01:10:06.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.104879ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
74212025-01-09T01:10:07.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4eae03c2-af08-4ce7-b16b-01d8be391e5e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74222025-01-09T01:10:07.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4eae03c2-af08-4ce7-b16b-01d8be391e5e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74232025-01-09T01:10:07.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4eae03c2-af08-4ce7-b16b-01d8be391e5e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74242025-01-09T01:10:08.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67032fc1-2818-469e-9603-fb5bb7f89782 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74252025-01-09T01:10:08.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67032fc1-2818-469e-9603-fb5bb7f89782 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74262025-01-09T01:10:08.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67032fc1-2818-469e-9603-fb5bb7f89782 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74272025-01-09T01:10:09.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c98713c0-c83c-4128-933c-a1727d423e11 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74282025-01-09T01:10:09.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c98713c0-c83c-4128-933c-a1727d423e11 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74292025-01-09T01:10:09.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c98713c0-c83c-4128-933c-a1727d423e11 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74302025-01-09T01:10:09.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = db3cbf86-9d9c-4bfe-b4d9-7025faa16fc4 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
74312025-01-09T01:10:10.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0f98a74b-8ff3-44b9-bc24-b80e87e4ffa5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74322025-01-09T01:10:10.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0f98a74b-8ff3-44b9-bc24-b80e87e4ffa5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74332025-01-09T01:10:10.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0f98a74b-8ff3-44b9-bc24-b80e87e4ffa5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74342025-01-09T01:10:11.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3ed314fe-51a4-4c40-b52b-d1ed39502af2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74352025-01-09T01:10:11.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3ed314fe-51a4-4c40-b52b-d1ed39502af2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74362025-01-09T01:10:11.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3ed314fe-51a4-4c40-b52b-d1ed39502af2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74372025-01-09T01:10:12.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eabe0963-f834-4936-9b3d-416a75f93515 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74382025-01-09T01:10:12.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eabe0963-f834-4936-9b3d-416a75f93515 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74392025-01-09T01:10:12.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eabe0963-f834-4936-9b3d-416a75f93515 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74402025-01-09T01:10:13.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36f24854-ec21-4714-88ca-4251a383254d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74412025-01-09T01:10:13.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36f24854-ec21-4714-88ca-4251a383254d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74422025-01-09T01:10:13.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36f24854-ec21-4714-88ca-4251a383254d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74432025-01-09T01:10:14.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4aecc5fd-c445-4270-86c1-fcd42d623148 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74442025-01-09T01:10:14.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4aecc5fd-c445-4270-86c1-fcd42d623148 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74452025-01-09T01:10:14.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4aecc5fd-c445-4270-86c1-fcd42d623148 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74462025-01-09T01:10:15.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea0b4589-8c1d-4517-b311-68b3f32240b4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74472025-01-09T01:10:15.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea0b4589-8c1d-4517-b311-68b3f32240b4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74482025-01-09T01:10:15.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea0b4589-8c1d-4517-b311-68b3f32240b4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74492025-01-09T01:10:16.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3783119-3f04-4acf-ab28-0e16c06fbbd7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74502025-01-09T01:10:16.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3783119-3f04-4acf-ab28-0e16c06fbbd7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74512025-01-09T01:10:16.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3783119-3f04-4acf-ab28-0e16c06fbbd7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
74522025-01-09T01:10:16.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
74532025-01-09T01:10:16.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
74542025-01-09T01:10:16.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74552025-01-09T01:10:16.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74562025-01-09T01:10:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74572025-01-09T01:10:16.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74582025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
74592025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
74602025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74612025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
74622025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74632025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74642025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
74652025-01-09T01:10:16.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74662025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74672025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
74682025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
74692025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74702025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
74712025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74722025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
74732025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74742025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
74752025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74762025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74772025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
74782025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
74792025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74802025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74812025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
74822025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74832025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
74842025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74852025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
74862025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74872025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
74882025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74892025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74902025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74912025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74922025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74932025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74942025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74952025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74962025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74972025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74982025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74992025-01-09T01:10:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75002025-01-09T01:10:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75012025-01-09T01:10:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75022025-01-09T01:10:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75032025-01-09T01:10:16.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1460, tv_nsec: 361881696 } })
75042025-01-09T01:10:16.901ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75052025-01-09T01:10:16.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1460, tv_nsec: 362794067 } })
75062025-01-09T01:10:16.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75072025-01-09T01:10:16.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75082025-01-09T01:10:16.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75092025-01-09T01:10:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.816836ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
75102025-01-09T01:10:16.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.766905ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75112025-01-09T01:10:16.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75122025-01-09T01:10:16.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75132025-01-09T01:10:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75142025-01-09T01:10:16.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75152025-01-09T01:10:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75162025-01-09T01:10:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75172025-01-09T01:10:16.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75182025-01-09T01:10:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75192025-01-09T01:10:16.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75202025-01-09T01:10:16.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75212025-01-09T01:10:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75222025-01-09T01:10:16.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75232025-01-09T01:10:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75242025-01-09T01:10:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75252025-01-09T01:10:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75262025-01-09T01:10:16.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75272025-01-09T01:10:16.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75282025-01-09T01:10:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75292025-01-09T01:10:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.699196ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
75302025-01-09T01:10:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75312025-01-09T01:10:16.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75322025-01-09T01:10:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75332025-01-09T01:10:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75342025-01-09T01:10:16.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75352025-01-09T01:10:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75362025-01-09T01:10:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75372025-01-09T01:10:16.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75382025-01-09T01:10:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75392025-01-09T01:10:16.919ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1460, tv_nsec: 380008835 } })
75402025-01-09T01:10:16.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75412025-01-09T01:10:16.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
75422025-01-09T01:10:16.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75432025-01-09T01:10:16.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.007711ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75442025-01-09T01:10:16.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75452025-01-09T01:10:16.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75462025-01-09T01:10:16.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75472025-01-09T01:10:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75482025-01-09T01:10:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75492025-01-09T01:10:16.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75502025-01-09T01:10:16.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75512025-01-09T01:10:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75522025-01-09T01:10:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75532025-01-09T01:10:16.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75542025-01-09T01:10:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75552025-01-09T01:10:16.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75562025-01-09T01:10:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
75572025-01-09T01:10:16.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75582025-01-09T01:10:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75592025-01-09T01:10:16.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75602025-01-09T01:10:16.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75612025-01-09T01:10:16.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75622025-01-09T01:10:16.946ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75632025-01-09T01:10:16.946ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75642025-01-09T01:10:16.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75652025-01-09T01:10:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75662025-01-09T01:10:16.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75672025-01-09T01:10:16.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75682025-01-09T01:10:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75692025-01-09T01:10:16.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
75702025-01-09T01:10:16.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.759572ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
75712025-01-09T01:10:16.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722025-01-09T01:10:16.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75732025-01-09T01:10:16.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75742025-01-09T01:10:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75752025-01-09T01:10:16.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75762025-01-09T01:10:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75772025-01-09T01:10:16.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75782025-01-09T01:10:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75792025-01-09T01:10:16.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75802025-01-09T01:10:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75812025-01-09T01:10:16.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75822025-01-09T01:10:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75832025-01-09T01:10:16.966ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75842025-01-09T01:10:16.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.751843ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75852025-01-09T01:10:16.970ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 69.724253ms iteration = 16 status = {"physical_disks_added":0}
75862025-01-09T01:10:16.982ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75872025-01-09T01:10:16.982ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75882025-01-09T01:10:16.982ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75892025-01-09T01:10:16.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75902025-01-09T01:10:16.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75912025-01-09T01:10:16.985ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75922025-01-09T01:10:16.985ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78b2609e-a653-407f-849c-7e4e38cad858", "content-length": "26", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
75932025-01-09T01:10:16.985ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75942025-01-09T01:10:16.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75952025-01-09T01:10:16.997ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75962025-01-09T01:10:16.997ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75972025-01-09T01:10:16.997ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a66f1b8-e3fb-495d-805e-52334bf76785", "content-length": "26", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
75982025-01-09T01:10:16.997ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75992025-01-09T01:10:16.999ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76002025-01-09T01:10:17.041ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76012025-01-09T01:10:17.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76022025-01-09T01:10:17.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.867215ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76032025-01-09T01:10:17.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76042025-01-09T01:10:17.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76052025-01-09T01:10:17.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76062025-01-09T01:10:17.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76072025-01-09T01:10:17.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 172.459991ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76082025-01-09T01:10:17.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
76092025-01-09T01:10:17.073ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76102025-01-09T01:10:17.073ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1edc10e4-cde1-41a6-b281-e99e45c04585", "content-length": "26", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
76112025-01-09T01:10:17.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76122025-01-09T01:10:17.074ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76132025-01-09T01:10:17.074ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76142025-01-09T01:10:17.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.028826ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76152025-01-09T01:10:17.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
76162025-01-09T01:10:17.102ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "790eb689-7a5e-4841-95bc-70f4f011e8d4", "content-length": "372", "date": "Thu, 09 Jan 2025 01:10:17 GMT"} })
76172025-01-09T01:10:17.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76182025-01-09T01:10:17.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76192025-01-09T01:10:17.142ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 243.290199ms iteration = 14 status = {}
76202025-01-09T01:10:17.149ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76212025-01-09T01:10:17.149ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a25c7ca9-2ddd-49ab-a0d9-0ba707d87af2", "content-length": "1", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
76222025-01-09T01:10:17.151ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76232025-01-09T01:10:17.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76242025-01-09T01:10:17.179ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76252025-01-09T01:10:17.180ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccdd7f6d-556e-4f6e-843b-18eeec96d3ff", "content-length": "691", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
76262025-01-09T01:10:17.180ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76272025-01-09T01:10:17.180ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76282025-01-09T01:10:17.180ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76292025-01-09T01:10:17.182ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 281.575153ms iteration = 14 status = {}
76302025-01-09T01:10:17.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76312025-01-09T01:10:17.183ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 284.500489ms iteration = 14 status = null
76322025-01-09T01:10:17.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
76332025-01-09T01:10:17.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76342025-01-09T01:10:17.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76352025-01-09T01:10:17.186ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 286.577626ms iteration = 14 status = 0
76362025-01-09T01:10:17.212ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 312.44751ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
76372025-01-09T01:10:17.222ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
76382025-01-09T01:10:17.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76392025-01-09T01:10:17.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "599afc90-d136-406a-8d99-025eb383b056", "date": "Thu, 09 Jan 2025 01:10:17 GMT"} })
76402025-01-09T01:10:17.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76412025-01-09T01:10:17.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76422025-01-09T01:10:17.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76432025-01-09T01:10:17.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76442025-01-09T01:10:17.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76452025-01-09T01:10:17.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76462025-01-09T01:10:17.230ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76472025-01-09T01:10:17.230ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76482025-01-09T01:10:17.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cc939a05-0ed2-4b3c-9f8b-2dec65ea6fd6", "date": "Thu, 09 Jan 2025 01:10:17 GMT"} })
76492025-01-09T01:10:17.232ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 332.226225ms iteration = 14 status = {}
76502025-01-09T01:10:17.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76512025-01-09T01:10:17.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76522025-01-09T01:10:17.235ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
76532025-01-09T01:10:17.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76542025-01-09T01:10:17.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76552025-01-09T01:10:17.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76562025-01-09T01:10:17.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ce015ad-a7e5-4963-bcbc-5aa791cde72d", "content-length": "134", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
76572025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76582025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
76592025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76602025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76612025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76622025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76632025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76642025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76652025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76662025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76672025-01-09T01:10:17.245ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
76682025-01-09T01:10:17.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76692025-01-09T01:10:17.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76702025-01-09T01:10:17.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76712025-01-09T01:10:17.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f25ddb8-884a-4beb-811b-b33767801429", "content-length": "2", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
76722025-01-09T01:10:17.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76732025-01-09T01:10:17.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "afa38301-afee-4b7c-9983-47bc777cd07e", "content-length": "52", "date": "Thu, 09 Jan 2025 01:10:16 GMT"} })
76742025-01-09T01:10:17.248ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
76752025-01-09T01:10:17.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76762025-01-09T01:10:17.344ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "85e6c975-d616-414d-81a4-e9a74f32f478", "date": "Thu, 09 Jan 2025 01:10:17 GMT"} })
76772025-01-09T01:10:17.344ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
76782025-01-09T01:10:17.344ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76792025-01-09T01:10:17.344ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "16824f56-37b9-4fa7-9853-bc2838d400d2", "content-length": "682", "date": "Thu, 09 Jan 2025 01:10:17 GMT"} })
76802025-01-09T01:10:17.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76812025-01-09T01:10:17.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76822025-01-09T01:10:17.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76832025-01-09T01:10:17.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76842025-01-09T01:10:17.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76852025-01-09T01:10:17.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76862025-01-09T01:10:17.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76872025-01-09T01:10:17.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76882025-01-09T01:10:17.360ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 460.458779ms iteration = 14 status = {}
76892025-01-09T01:10:17.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2b998ee-3faa-4e2c-909d-eee3e5c97d19 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76902025-01-09T01:10:17.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2b998ee-3faa-4e2c-909d-eee3e5c97d19 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76912025-01-09T01:10:17.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2b998ee-3faa-4e2c-909d-eee3e5c97d19 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76922025-01-09T01:10:18.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 74339e45-3aad-47d0-b3ef-e7a470c6b6b0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76932025-01-09T01:10:18.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 74339e45-3aad-47d0-b3ef-e7a470c6b6b0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76942025-01-09T01:10:18.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 74339e45-3aad-47d0-b3ef-e7a470c6b6b0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76952025-01-09T01:10:19.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 17cb2a1f-1b8c-460d-b2b6-7076ba70ef5f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76962025-01-09T01:10:19.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 17cb2a1f-1b8c-460d-b2b6-7076ba70ef5f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76972025-01-09T01:10:19.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 17cb2a1f-1b8c-460d-b2b6-7076ba70ef5f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
76982025-01-09T01:10:19.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 447 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 339a5bb6-62f4-41e1-af95-4b3b81cb9c35 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
76992025-01-09T01:10:20.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7b2ade4-3531-4e8c-8ce7-86a91c933a38 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77002025-01-09T01:10:20.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7b2ade4-3531-4e8c-8ce7-86a91c933a38 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77012025-01-09T01:10:20.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7b2ade4-3531-4e8c-8ce7-86a91c933a38 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77022025-01-09T01:10:21.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1df6bf1d-9873-4272-8c37-1f698f9d0ad4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77032025-01-09T01:10:21.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1df6bf1d-9873-4272-8c37-1f698f9d0ad4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77042025-01-09T01:10:21.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1df6bf1d-9873-4272-8c37-1f698f9d0ad4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77052025-01-09T01:10:22.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 04e9fcdd-64c8-4da4-911e-c26a81dbee97 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77062025-01-09T01:10:22.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 04e9fcdd-64c8-4da4-911e-c26a81dbee97 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77072025-01-09T01:10:22.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 04e9fcdd-64c8-4da4-911e-c26a81dbee97 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77082025-01-09T01:10:23.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1ecfa5f4-3e46-4924-bace-aa4ad6809583 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77092025-01-09T01:10:23.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1ecfa5f4-3e46-4924-bace-aa4ad6809583 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77102025-01-09T01:10:23.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1ecfa5f4-3e46-4924-bace-aa4ad6809583 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77112025-01-09T01:10:24.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 83e30caa-22c2-448c-a26a-55b8a9917c3b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77122025-01-09T01:10:24.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 83e30caa-22c2-448c-a26a-55b8a9917c3b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77132025-01-09T01:10:24.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 83e30caa-22c2-448c-a26a-55b8a9917c3b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77142025-01-09T01:10:25.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1572d030-2f08-43dd-bedc-e0cf17946ec4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77152025-01-09T01:10:25.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1572d030-2f08-43dd-bedc-e0cf17946ec4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77162025-01-09T01:10:25.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1572d030-2f08-43dd-bedc-e0cf17946ec4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77172025-01-09T01:10:26.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c4524b3b-4899-44c7-89ce-246bfd18bb93 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77182025-01-09T01:10:26.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c4524b3b-4899-44c7-89ce-246bfd18bb93 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77192025-01-09T01:10:26.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c4524b3b-4899-44c7-89ce-246bfd18bb93 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77202025-01-09T01:10:26.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
77212025-01-09T01:10:26.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
77222025-01-09T01:10:26.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77232025-01-09T01:10:26.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77242025-01-09T01:10:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77252025-01-09T01:10:26.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77262025-01-09T01:10:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77272025-01-09T01:10:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77282025-01-09T01:10:26.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77292025-01-09T01:10:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77302025-01-09T01:10:26.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77312025-01-09T01:10:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77322025-01-09T01:10:26.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77332025-01-09T01:10:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
77342025-01-09T01:10:26.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77352025-01-09T01:10:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77362025-01-09T01:10:26.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
77372025-01-09T01:10:26.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.512591ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
77382025-01-09T01:10:26.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77392025-01-09T01:10:26.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77402025-01-09T01:10:26.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.939675ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77412025-01-09T01:10:27.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b52454c5-96ae-492f-bd0a-50fd6c3d5afc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77422025-01-09T01:10:27.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b52454c5-96ae-492f-bd0a-50fd6c3d5afc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77432025-01-09T01:10:27.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b52454c5-96ae-492f-bd0a-50fd6c3d5afc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77442025-01-09T01:10:28.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b71da0cd-8c67-4a61-97c1-5b19d63bac6d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77452025-01-09T01:10:28.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b71da0cd-8c67-4a61-97c1-5b19d63bac6d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77462025-01-09T01:10:28.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b71da0cd-8c67-4a61-97c1-5b19d63bac6d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77472025-01-09T01:10:29.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2f48c39a-ad9b-433c-810a-dda24706d43f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77482025-01-09T01:10:29.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2f48c39a-ad9b-433c-810a-dda24706d43f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77492025-01-09T01:10:29.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2f48c39a-ad9b-433c-810a-dda24706d43f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77502025-01-09T01:10:29.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 619 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 1c151eeb-2dd1-4fa0-af05-28285a3c3777 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
77512025-01-09T01:10:30.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e56b53ce-41d8-484b-b014-2b8e8f57be05 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77522025-01-09T01:10:30.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e56b53ce-41d8-484b-b014-2b8e8f57be05 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77532025-01-09T01:10:30.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e56b53ce-41d8-484b-b014-2b8e8f57be05 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77542025-01-09T01:10:31.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26515029-2a89-4700-a10e-f930d0bfa7c1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77552025-01-09T01:10:31.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26515029-2a89-4700-a10e-f930d0bfa7c1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77562025-01-09T01:10:31.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26515029-2a89-4700-a10e-f930d0bfa7c1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77572025-01-09T01:10:32.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 62069680-92e8-4e88-9e35-ad1f002cea4c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77582025-01-09T01:10:32.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 62069680-92e8-4e88-9e35-ad1f002cea4c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77592025-01-09T01:10:32.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 62069680-92e8-4e88-9e35-ad1f002cea4c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77602025-01-09T01:10:33.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b791a161-74d4-4f1e-b44a-b7b12520f196 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77612025-01-09T01:10:33.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b791a161-74d4-4f1e-b44a-b7b12520f196 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77622025-01-09T01:10:33.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b791a161-74d4-4f1e-b44a-b7b12520f196 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77632025-01-09T01:10:34.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d513a1cc-b786-404b-ad11-ecedf7f6e941 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77642025-01-09T01:10:34.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d513a1cc-b786-404b-ad11-ecedf7f6e941 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77652025-01-09T01:10:34.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d513a1cc-b786-404b-ad11-ecedf7f6e941 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77662025-01-09T01:10:35.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c3691b0f-824a-477b-b8da-c87a271bc844 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77672025-01-09T01:10:35.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c3691b0f-824a-477b-b8da-c87a271bc844 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77682025-01-09T01:10:35.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c3691b0f-824a-477b-b8da-c87a271bc844 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77692025-01-09T01:10:36.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 352a8e90-8de5-4ce6-9528-50ee978d1940 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77702025-01-09T01:10:36.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 352a8e90-8de5-4ce6-9528-50ee978d1940 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77712025-01-09T01:10:36.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 352a8e90-8de5-4ce6-9528-50ee978d1940 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77722025-01-09T01:10:36.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
77732025-01-09T01:10:36.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77742025-01-09T01:10:36.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
77752025-01-09T01:10:36.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77762025-01-09T01:10:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77772025-01-09T01:10:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77782025-01-09T01:10:36.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77792025-01-09T01:10:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77802025-01-09T01:10:36.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77812025-01-09T01:10:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77822025-01-09T01:10:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77832025-01-09T01:10:36.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77842025-01-09T01:10:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77852025-01-09T01:10:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
77862025-01-09T01:10:36.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77872025-01-09T01:10:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77882025-01-09T01:10:36.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
77892025-01-09T01:10:36.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.432216ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
77902025-01-09T01:10:36.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77912025-01-09T01:10:36.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77922025-01-09T01:10:36.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.497668ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77932025-01-09T01:10:37.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aab64d83-8180-4989-80cf-5d2d2da230e1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77942025-01-09T01:10:37.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aab64d83-8180-4989-80cf-5d2d2da230e1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77952025-01-09T01:10:37.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = aab64d83-8180-4989-80cf-5d2d2da230e1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77962025-01-09T01:10:38.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 339946bf-206d-4bfb-bd5d-b9742ebce74b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77972025-01-09T01:10:38.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 339946bf-206d-4bfb-bd5d-b9742ebce74b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77982025-01-09T01:10:38.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 339946bf-206d-4bfb-bd5d-b9742ebce74b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
77992025-01-09T01:10:39.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1b2fee62-893a-4db0-bb9d-874574a7e6cf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78002025-01-09T01:10:39.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1b2fee62-893a-4db0-bb9d-874574a7e6cf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78012025-01-09T01:10:39.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1b2fee62-893a-4db0-bb9d-874574a7e6cf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78022025-01-09T01:10:39.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 4fdeb7c1-1b10-480a-a03f-9fabfd698230 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
78032025-01-09T01:10:40.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0eed9ee8-1e45-4ead-8316-f1d423c479b7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78042025-01-09T01:10:40.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0eed9ee8-1e45-4ead-8316-f1d423c479b7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78052025-01-09T01:10:40.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0eed9ee8-1e45-4ead-8316-f1d423c479b7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78062025-01-09T01:10:41.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 90f79fb1-239b-4759-90f3-411bcf75a8fb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78072025-01-09T01:10:41.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 90f79fb1-239b-4759-90f3-411bcf75a8fb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78082025-01-09T01:10:41.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 90f79fb1-239b-4759-90f3-411bcf75a8fb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78092025-01-09T01:10:43.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2d55df85-5dc5-4eea-ad2f-a28f13da2404 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78102025-01-09T01:10:43.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2d55df85-5dc5-4eea-ad2f-a28f13da2404 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78112025-01-09T01:10:43.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2d55df85-5dc5-4eea-ad2f-a28f13da2404 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78122025-01-09T01:10:44.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 934277af-bf1c-4eb3-b385-44cbe8d0aeec roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78132025-01-09T01:10:44.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 934277af-bf1c-4eb3-b385-44cbe8d0aeec resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78142025-01-09T01:10:44.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 934277af-bf1c-4eb3-b385-44cbe8d0aeec response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78152025-01-09T01:10:45.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cb643b09-95fa-4521-aca4-55fb2dca2c40 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78162025-01-09T01:10:45.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cb643b09-95fa-4521-aca4-55fb2dca2c40 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78172025-01-09T01:10:45.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cb643b09-95fa-4521-aca4-55fb2dca2c40 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78182025-01-09T01:10:46.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9a02b15-4ede-484b-995f-3901c42dc62a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78192025-01-09T01:10:46.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9a02b15-4ede-484b-995f-3901c42dc62a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78202025-01-09T01:10:46.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9a02b15-4ede-484b-995f-3901c42dc62a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
78212025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
78222025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
78232025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
78242025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78252025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78262025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
78272025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
78282025-01-09T01:10:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:00:46.899124957 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
78292025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
78302025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78312025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
78322025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
78332025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
78342025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78352025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
78362025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
78372025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78382025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
78392025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
78402025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78412025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78422025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78432025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
78442025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78452025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78462025-01-09T01:10:46.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 359790843 } })
78472025-01-09T01:10:46.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 359854995 } })
78482025-01-09T01:10:46.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78492025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
78502025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78512025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78522025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78532025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78542025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
78552025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78562025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
78572025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78582025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
78592025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
78602025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
78612025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78622025-01-09T01:10:46.900ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
78632025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78642025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
78652025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.13\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
78662025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
78672025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
78682025-01-09T01:10:46.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78692025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
78702025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78712025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78722025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78732025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78742025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
78752025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78762025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
78772025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78782025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
78792025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78802025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
78812025-01-09T01:10:46.900ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
78822025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78832025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
78842025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78852025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
78862025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78872025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
78882025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78892025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78902025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78912025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78922025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78932025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
78942025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.32031ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
78952025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
78962025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.274698ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
78972025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78982025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78992025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79002025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
79012025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79022025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79032025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79042025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79052025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79062025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79072025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
79082025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79092025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79102025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79112025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79122025-01-09T01:10:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79132025-01-09T01:10:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79142025-01-09T01:10:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79152025-01-09T01:10:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79162025-01-09T01:10:46.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79172025-01-09T01:10:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79182025-01-09T01:10:46.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79192025-01-09T01:10:46.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79202025-01-09T01:10:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79212025-01-09T01:10:46.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:00:46.899124957 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
79222025-01-09T01:10:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.936442ms iteration = 8 status = {"expiration":"2025-01-09T01:00:46.899124957Z","pruned":[]}
79232025-01-09T01:10:46.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 365304778 } })
79242025-01-09T01:10:46.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
79252025-01-09T01:10:46.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 366073005 } })
79262025-01-09T01:10:46.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
79272025-01-09T01:10:46.908ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.671526ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79282025-01-09T01:10:46.912ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.631255ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
79292025-01-09T01:10:46.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.31317ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
79302025-01-09T01:10:46.952ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79312025-01-09T01:10:46.952ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79322025-01-09T01:10:46.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79332025-01-09T01:10:46.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79342025-01-09T01:10:46.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.553142ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
79352025-01-09T01:10:46.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79362025-01-09T01:10:46.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79372025-01-09T01:10:46.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79382025-01-09T01:10:46.956ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79392025-01-09T01:10:46.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79402025-01-09T01:10:46.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79412025-01-09T01:10:46.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422025-01-09T01:10:46.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79432025-01-09T01:10:46.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79442025-01-09T01:10:46.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79452025-01-09T01:10:46.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79462025-01-09T01:10:46.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79472025-01-09T01:10:46.960ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79482025-01-09T01:10:46.960ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79492025-01-09T01:10:46.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79502025-01-09T01:10:46.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79512025-01-09T01:10:46.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79522025-01-09T01:10:46.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79532025-01-09T01:10:46.962ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79542025-01-09T01:10:46.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79552025-01-09T01:10:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79562025-01-09T01:10:46.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79572025-01-09T01:10:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79582025-01-09T01:10:46.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79592025-01-09T01:10:46.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79602025-01-09T01:10:46.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79612025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79622025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79632025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79642025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79652025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79662025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79672025-01-09T01:10:46.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79682025-01-09T01:10:46.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79692025-01-09T01:10:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79702025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79712025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79722025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79732025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79742025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79752025-01-09T01:10:46.970ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79762025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.582023ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79772025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79782025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79792025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79802025-01-09T01:10:46.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79812025-01-09T01:10:46.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79822025-01-09T01:10:46.972ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.405584ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79832025-01-09T01:10:46.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79842025-01-09T01:10:46.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79852025-01-09T01:10:46.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79862025-01-09T01:10:46.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.861839ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79872025-01-09T01:10:46.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79882025-01-09T01:10:46.976ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 436490213 } })
79892025-01-09T01:10:46.976ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
79902025-01-09T01:10:46.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79912025-01-09T01:10:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79922025-01-09T01:10:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79932025-01-09T01:10:46.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79942025-01-09T01:10:46.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79952025-01-09T01:10:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79962025-01-09T01:10:46.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79972025-01-09T01:10:46.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79982025-01-09T01:10:47.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79992025-01-09T01:10:47.004ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80002025-01-09T01:10:47.004ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80012025-01-09T01:10:47.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80022025-01-09T01:10:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80032025-01-09T01:10:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80042025-01-09T01:10:47.006ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80052025-01-09T01:10:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80062025-01-09T01:10:47.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80072025-01-09T01:10:47.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80082025-01-09T01:10:47.013ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80092025-01-09T01:10:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80102025-01-09T01:10:47.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80112025-01-09T01:10:47.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80122025-01-09T01:10:47.022ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.832878ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80132025-01-09T01:10:47.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80142025-01-09T01:10:47.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80152025-01-09T01:10:47.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80162025-01-09T01:10:47.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80172025-01-09T01:10:47.028ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
80182025-01-09T01:10:47.028ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
80192025-01-09T01:10:47.028ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.56247ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
80202025-01-09T01:10:47.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80212025-01-09T01:10:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80222025-01-09T01:10:47.031ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80232025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.035757ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80242025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
80252025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80262025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80272025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
80282025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80292025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80302025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80312025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
80322025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
80332025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
80342025-01-09T01:10:47.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80352025-01-09T01:10:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80362025-01-09T01:10:47.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80372025-01-09T01:10:47.034ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.542356ms iteration = 15 status = 0
80382025-01-09T01:10:47.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80392025-01-09T01:10:47.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80402025-01-09T01:10:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80412025-01-09T01:10:47.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80422025-01-09T01:10:47.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80432025-01-09T01:10:47.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80442025-01-09T01:10:47.040ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80452025-01-09T01:10:47.040ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80462025-01-09T01:10:47.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80472025-01-09T01:10:47.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80482025-01-09T01:10:47.042ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
80492025-01-09T01:10:47.042ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 142.528426ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
80502025-01-09T01:10:47.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512025-01-09T01:10:47.043ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80522025-01-09T01:10:47.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80532025-01-09T01:10:47.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80542025-01-09T01:10:47.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80552025-01-09T01:10:47.048ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80562025-01-09T01:10:47.048ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80572025-01-09T01:10:47.048ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
80582025-01-09T01:10:47.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 149.657226ms iteration = 8 status = {"generation":1}
80592025-01-09T01:10:47.053ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80602025-01-09T01:10:47.053ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80612025-01-09T01:10:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.299859ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80622025-01-09T01:10:47.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 161.073284ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80632025-01-09T01:10:47.061ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
80642025-01-09T01:10:47.061ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
80652025-01-09T01:10:47.061ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
80662025-01-09T01:10:47.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80672025-01-09T01:10:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80682025-01-09T01:10:47.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80692025-01-09T01:10:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80702025-01-09T01:10:47.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80712025-01-09T01:10:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80722025-01-09T01:10:47.069ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80732025-01-09T01:10:47.069ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80742025-01-09T01:10:47.070ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8921d11-06a6-42c5-8a2c-fda5e9937069", "content-length": "26", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} })
80752025-01-09T01:10:47.070ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80762025-01-09T01:10:47.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80772025-01-09T01:10:47.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80782025-01-09T01:10:47.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80792025-01-09T01:10:47.081ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
80802025-01-09T01:10:47.081ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.807334ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80812025-01-09T01:10:47.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0dadc9e-9c8c-4253-a3e0-50729fbf956d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
80822025-01-09T01:10:47.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0dadc9e-9c8c-4253-a3e0-50729fbf956d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
80832025-01-09T01:10:47.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0dadc9e-9c8c-4253-a3e0-50729fbf956d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
80842025-01-09T01:10:47.097ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80852025-01-09T01:10:47.097ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
80862025-01-09T01:10:47.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80872025-01-09T01:10:47.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80882025-01-09T01:10:47.098ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
80892025-01-09T01:10:47.098ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.970909ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80902025-01-09T01:10:47.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80912025-01-09T01:10:47.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80922025-01-09T01:10:47.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80932025-01-09T01:10:47.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80942025-01-09T01:10:47.128ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.390123ms iteration = 17 status = {"physical_disks_added":0}
80952025-01-09T01:10:47.145ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
80962025-01-09T01:10:47.145ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80972025-01-09T01:10:47.146ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08e9889f-ef4e-44b4-a1af-e90cdd55db13", "content-length": "26", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} })
80982025-01-09T01:10:47.146ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80992025-01-09T01:10:47.148ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
81002025-01-09T01:10:47.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81012025-01-09T01:10:47.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81022025-01-09T01:10:47.158ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
81032025-01-09T01:10:47.209ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81042025-01-09T01:10:47.209ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81052025-01-09T01:10:47.209ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88846765-f7a8-4eea-9b4c-7f7ef379d4ea", "content-length": "26", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} })
81062025-01-09T01:10:47.209ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81072025-01-09T01:10:47.210ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81082025-01-09T01:10:47.222ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
81092025-01-09T01:10:47.223ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7f51def9-6066-4a9e-a02d-f32112535151", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81102025-01-09T01:10:47.223ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81112025-01-09T01:10:47.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "970da209-0729-4fb5-bfc9-973f81fb1cd2", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81122025-01-09T01:10:47.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81132025-01-09T01:10:47.226ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
81142025-01-09T01:10:47.226ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 327.211363ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
81152025-01-09T01:10:47.318ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
81162025-01-09T01:10:47.337ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81172025-01-09T01:10:47.338ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b12b4336-0fb3-49ea-b0d4-6658b2d6ad24", "content-length": "1", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81182025-01-09T01:10:47.341ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81192025-01-09T01:10:47.341ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.114005ms iteration = 15 status = {}
81202025-01-09T01:10:47.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81212025-01-09T01:10:47.349ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81222025-01-09T01:10:47.349ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81232025-01-09T01:10:47.349ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb5ecf21-7e13-44ec-b1d1-1a233eb80218", "content-length": "372", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81242025-01-09T01:10:47.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81252025-01-09T01:10:47.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81262025-01-09T01:10:47.350ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
81272025-01-09T01:10:47.350ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
81282025-01-09T01:10:47.350ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
81292025-01-09T01:10:47.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 451.559898ms iteration = 8 status = {"generation":2}
81302025-01-09T01:10:47.352ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 453.113923ms iteration = 15 status = null
81312025-01-09T01:10:47.383ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81322025-01-09T01:10:47.383ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0abe366e-2ec5-40cf-a86e-f6a2d979d81e", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81332025-01-09T01:10:47.383ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81342025-01-09T01:10:47.384ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cd7e42ae-a847-4e38-9d00-64cdd780c452", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81352025-01-09T01:10:47.384ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81362025-01-09T01:10:47.386ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cbbd1525-8714-4ffc-8fb9-bd9040a177a6", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81372025-01-09T01:10:47.386ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81382025-01-09T01:10:47.387ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
81392025-01-09T01:10:47.387ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 488.568043ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
81402025-01-09T01:10:47.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81412025-01-09T01:10:47.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81422025-01-09T01:10:47.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81432025-01-09T01:10:47.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81442025-01-09T01:10:47.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81452025-01-09T01:10:47.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81462025-01-09T01:10:47.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81472025-01-09T01:10:47.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81482025-01-09T01:10:47.398ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81492025-01-09T01:10:47.398ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81502025-01-09T01:10:47.398ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "662a7ed1-e623-4ae0-b5e1-ba4db16214ad", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81512025-01-09T01:10:47.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81522025-01-09T01:10:47.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81532025-01-09T01:10:47.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81542025-01-09T01:10:47.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81552025-01-09T01:10:47.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81562025-01-09T01:10:47.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81572025-01-09T01:10:47.407ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81582025-01-09T01:10:47.407ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81592025-01-09T01:10:47.408ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ebf1e95-bd2e-4fb6-b826-d6ad8b68f009", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81602025-01-09T01:10:47.409ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 509.782532ms iteration = 15 status = {}
81612025-01-09T01:10:47.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81622025-01-09T01:10:47.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81632025-01-09T01:10:47.419ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
81642025-01-09T01:10:47.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81652025-01-09T01:10:47.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81662025-01-09T01:10:47.438ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81672025-01-09T01:10:47.439ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "67bef48d-eb51-4618-9a13-5d51367dd034", "content-length": "691", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81682025-01-09T01:10:47.439ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81692025-01-09T01:10:47.439ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81702025-01-09T01:10:47.439ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81712025-01-09T01:10:47.440ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 540.564966ms iteration = 15 status = {}
81722025-01-09T01:10:47.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81732025-01-09T01:10:47.449ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "988cd4a7-2509-4926-8969-5082cd2ae191", "content-length": "134", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81742025-01-09T01:10:47.449ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81752025-01-09T01:10:47.449ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
81762025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81772025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81782025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81792025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81802025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81812025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81822025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81832025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81842025-01-09T01:10:47.450ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
81852025-01-09T01:10:47.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81862025-01-09T01:10:47.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81872025-01-09T01:10:47.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81882025-01-09T01:10:47.452ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a4fe81-8673-4dcc-bfc2-a97c1ee82c00", "content-length": "2", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81892025-01-09T01:10:47.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81902025-01-09T01:10:47.452ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab3edcb5-09f2-474f-9302-bfd9e47d8c54", "content-length": "52", "date": "Thu, 09 Jan 2025 01:10:47 GMT"} })
81912025-01-09T01:10:47.452ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
81922025-01-09T01:10:47.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81932025-01-09T01:10:47.550ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9648c25d-a9d7-492a-9214-f729080f2ce4", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} })
81942025-01-09T01:10:47.550ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
81952025-01-09T01:10:47.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81962025-01-09T01:10:47.551ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a39e710-d455-4e6a-be12-b9a18183b559", "content-length": "682", "date": "Thu, 09 Jan 2025 01:10:46 GMT"} })
81972025-01-09T01:10:47.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81982025-01-09T01:10:47.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81992025-01-09T01:10:47.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82002025-01-09T01:10:47.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82012025-01-09T01:10:47.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82022025-01-09T01:10:47.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82032025-01-09T01:10:47.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82042025-01-09T01:10:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82052025-01-09T01:10:47.565ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 665.824532ms iteration = 15 status = {}
82062025-01-09T01:10:48.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cbfe12da-e0f9-415d-b05a-03d40a1d2c5b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82072025-01-09T01:10:48.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cbfe12da-e0f9-415d-b05a-03d40a1d2c5b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82082025-01-09T01:10:48.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cbfe12da-e0f9-415d-b05a-03d40a1d2c5b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82092025-01-09T01:10:49.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b40c9252-39ed-4b36-8c4d-8fa9e575d3d3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82102025-01-09T01:10:49.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b40c9252-39ed-4b36-8c4d-8fa9e575d3d3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82112025-01-09T01:10:49.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b40c9252-39ed-4b36-8c4d-8fa9e575d3d3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82122025-01-09T01:10:49.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 6f1dd0d1-7462-4e0b-a05f-a4c0362624c5 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
82132025-01-09T01:10:50.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 47fd380e-aeec-44f4-87b9-404e4e873d42 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82142025-01-09T01:10:50.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 47fd380e-aeec-44f4-87b9-404e4e873d42 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82152025-01-09T01:10:50.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 47fd380e-aeec-44f4-87b9-404e4e873d42 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82162025-01-09T01:10:51.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2f6ac6c5-6dae-4512-80b2-0b1d22c4f6f2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82172025-01-09T01:10:51.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2f6ac6c5-6dae-4512-80b2-0b1d22c4f6f2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82182025-01-09T01:10:51.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2f6ac6c5-6dae-4512-80b2-0b1d22c4f6f2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82192025-01-09T01:10:52.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 41ae7db6-5c52-4929-8b5e-4108406d6f0e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82202025-01-09T01:10:52.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 41ae7db6-5c52-4929-8b5e-4108406d6f0e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82212025-01-09T01:10:52.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 41ae7db6-5c52-4929-8b5e-4108406d6f0e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82222025-01-09T01:10:53.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9e1ecbb-d43d-4638-b087-6feef7df2aea roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82232025-01-09T01:10:53.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9e1ecbb-d43d-4638-b087-6feef7df2aea resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82242025-01-09T01:10:53.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9e1ecbb-d43d-4638-b087-6feef7df2aea response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82252025-01-09T01:10:54.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19133e4a-4223-4cef-9f18-74f6b366bb96 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82262025-01-09T01:10:54.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19133e4a-4223-4cef-9f18-74f6b366bb96 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82272025-01-09T01:10:54.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19133e4a-4223-4cef-9f18-74f6b366bb96 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82282025-01-09T01:10:55.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7a74924d-0490-4ca4-9437-35ddfccfed9f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82292025-01-09T01:10:55.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7a74924d-0490-4ca4-9437-35ddfccfed9f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82302025-01-09T01:10:55.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7a74924d-0490-4ca4-9437-35ddfccfed9f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82312025-01-09T01:10:56.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8982d6b-1185-4884-8a3a-c736c9929b34 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82322025-01-09T01:10:56.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8982d6b-1185-4884-8a3a-c736c9929b34 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82332025-01-09T01:10:56.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c8982d6b-1185-4884-8a3a-c736c9929b34 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82342025-01-09T01:10:56.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
82352025-01-09T01:10:56.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
82362025-01-09T01:10:56.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82372025-01-09T01:10:56.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82382025-01-09T01:10:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82392025-01-09T01:10:56.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82402025-01-09T01:10:56.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82412025-01-09T01:10:56.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82422025-01-09T01:10:56.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82432025-01-09T01:10:56.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.913908ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82442025-01-09T01:10:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82452025-01-09T01:10:56.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82462025-01-09T01:10:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82472025-01-09T01:10:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82482025-01-09T01:10:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82492025-01-09T01:10:56.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502025-01-09T01:10:56.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
82512025-01-09T01:10:56.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82522025-01-09T01:10:56.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82532025-01-09T01:10:56.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
82542025-01-09T01:10:56.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.516888ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
82552025-01-09T01:10:57.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26e13de1-ac81-4139-97d0-17061dc230fc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82562025-01-09T01:10:57.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26e13de1-ac81-4139-97d0-17061dc230fc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82572025-01-09T01:10:57.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26e13de1-ac81-4139-97d0-17061dc230fc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82582025-01-09T01:10:58.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49123008-5e99-4d9b-9b8d-778c52ab5c47 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82592025-01-09T01:10:58.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49123008-5e99-4d9b-9b8d-778c52ab5c47 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82602025-01-09T01:10:58.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 49123008-5e99-4d9b-9b8d-778c52ab5c47 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82612025-01-09T01:10:59.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 48ec6f2f-403f-4417-ad36-ea9db71118a4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82622025-01-09T01:10:59.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 48ec6f2f-403f-4417-ad36-ea9db71118a4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82632025-01-09T01:10:59.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 48ec6f2f-403f-4417-ad36-ea9db71118a4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82642025-01-09T01:10:59.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = a207b641-9ed8-49e3-905c-24c90685901d response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
82652025-01-09T01:11:00.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 742aeda4-0841-41e4-b052-ecad39b4a283 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82662025-01-09T01:11:00.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 742aeda4-0841-41e4-b052-ecad39b4a283 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82672025-01-09T01:11:00.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 742aeda4-0841-41e4-b052-ecad39b4a283 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82682025-01-09T01:11:01.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7c507658-c9cf-4115-a4ec-d846a8765639 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82692025-01-09T01:11:01.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7c507658-c9cf-4115-a4ec-d846a8765639 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82702025-01-09T01:11:01.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7c507658-c9cf-4115-a4ec-d846a8765639 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82712025-01-09T01:11:02.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0f80f498-b105-44e1-9c9c-91c3f260d207 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82722025-01-09T01:11:02.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0f80f498-b105-44e1-9c9c-91c3f260d207 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82732025-01-09T01:11:02.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0f80f498-b105-44e1-9c9c-91c3f260d207 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82742025-01-09T01:11:03.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f97adc3a-b68f-4883-b7b3-c3b52a380fee roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82752025-01-09T01:11:03.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f97adc3a-b68f-4883-b7b3-c3b52a380fee resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82762025-01-09T01:11:03.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f97adc3a-b68f-4883-b7b3-c3b52a380fee response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82772025-01-09T01:11:04.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 74dfdae8-ab68-4d97-9849-de04f5cb1440 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82782025-01-09T01:11:04.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 74dfdae8-ab68-4d97-9849-de04f5cb1440 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82792025-01-09T01:11:04.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 74dfdae8-ab68-4d97-9849-de04f5cb1440 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82802025-01-09T01:11:05.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a847991f-d098-454f-aafb-cc29c5bebb3b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82812025-01-09T01:11:05.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a847991f-d098-454f-aafb-cc29c5bebb3b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82822025-01-09T01:11:05.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a847991f-d098-454f-aafb-cc29c5bebb3b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82832025-01-09T01:11:06.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ccdc3b20-2bc1-4844-a382-8937aeaa1e4a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82842025-01-09T01:11:06.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ccdc3b20-2bc1-4844-a382-8937aeaa1e4a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82852025-01-09T01:11:06.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ccdc3b20-2bc1-4844-a382-8937aeaa1e4a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
82862025-01-09T01:11:06.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
82872025-01-09T01:11:06.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
82882025-01-09T01:11:06.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82892025-01-09T01:11:06.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82902025-01-09T01:11:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82912025-01-09T01:11:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82922025-01-09T01:11:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82932025-01-09T01:11:06.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82942025-01-09T01:11:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82952025-01-09T01:11:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82962025-01-09T01:11:06.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82972025-01-09T01:11:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82982025-01-09T01:11:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82992025-01-09T01:11:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83002025-01-09T01:11:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012025-01-09T01:11:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
83022025-01-09T01:11:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83032025-01-09T01:11:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83042025-01-09T01:11:06.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
83052025-01-09T01:11:06.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.651351ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
83062025-01-09T01:11:06.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.841158ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83072025-01-09T01:11:07.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7c87ffa7-5302-4f02-9c44-c0f1154b7a44 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83082025-01-09T01:11:07.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7c87ffa7-5302-4f02-9c44-c0f1154b7a44 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83092025-01-09T01:11:07.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7c87ffa7-5302-4f02-9c44-c0f1154b7a44 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83102025-01-09T01:11:08.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5aebf3cc-8280-4a49-850e-8ceb3a0f47a9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83112025-01-09T01:11:08.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5aebf3cc-8280-4a49-850e-8ceb3a0f47a9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83122025-01-09T01:11:08.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5aebf3cc-8280-4a49-850e-8ceb3a0f47a9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83132025-01-09T01:11:09.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b3b7791f-242a-44d8-b904-199f370d302d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83142025-01-09T01:11:09.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b3b7791f-242a-44d8-b904-199f370d302d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83152025-01-09T01:11:09.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b3b7791f-242a-44d8-b904-199f370d302d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83162025-01-09T01:11:09.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 73490c1b-5b30-4576-9643-f19882185020 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
83172025-01-09T01:11:10.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 53b034b4-bbfe-4a29-80b4-d5876f63865e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83182025-01-09T01:11:10.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 53b034b4-bbfe-4a29-80b4-d5876f63865e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83192025-01-09T01:11:10.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 53b034b4-bbfe-4a29-80b4-d5876f63865e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83202025-01-09T01:11:11.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d8d2b572-f77b-463f-81f4-3d3b21a80738 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83212025-01-09T01:11:11.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d8d2b572-f77b-463f-81f4-3d3b21a80738 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83222025-01-09T01:11:11.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d8d2b572-f77b-463f-81f4-3d3b21a80738 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83232025-01-09T01:11:12.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5be1a97-5c33-4289-a855-aa5cf523e12f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83242025-01-09T01:11:12.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5be1a97-5c33-4289-a855-aa5cf523e12f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83252025-01-09T01:11:12.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e5be1a97-5c33-4289-a855-aa5cf523e12f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83262025-01-09T01:11:13.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c10ea176-d2ca-4eee-b105-722de96b7101 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83272025-01-09T01:11:13.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c10ea176-d2ca-4eee-b105-722de96b7101 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83282025-01-09T01:11:13.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c10ea176-d2ca-4eee-b105-722de96b7101 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83292025-01-09T01:11:14.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1630a57a-8bd6-49b9-b343-c8477c96e3c1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83302025-01-09T01:11:14.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1630a57a-8bd6-49b9-b343-c8477c96e3c1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83312025-01-09T01:11:14.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1630a57a-8bd6-49b9-b343-c8477c96e3c1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83322025-01-09T01:11:15.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76806fd8-5cc5-4e46-a4a0-3f10e3259221 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83332025-01-09T01:11:15.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76806fd8-5cc5-4e46-a4a0-3f10e3259221 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83342025-01-09T01:11:15.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76806fd8-5cc5-4e46-a4a0-3f10e3259221 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83352025-01-09T01:11:16.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2d14a428-65ab-4cdc-9b43-b40454e5a192 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83362025-01-09T01:11:16.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2d14a428-65ab-4cdc-9b43-b40454e5a192 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83372025-01-09T01:11:16.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2d14a428-65ab-4cdc-9b43-b40454e5a192 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
83382025-01-09T01:11:16.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
83392025-01-09T01:11:16.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83402025-01-09T01:11:16.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
83412025-01-09T01:11:16.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83422025-01-09T01:11:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83432025-01-09T01:11:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83442025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
83452025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
83462025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83472025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83482025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
83492025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
83502025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83512025-01-09T01:11:16.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83522025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83532025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83542025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
83552025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83562025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83572025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
83582025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83592025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
83602025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83612025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
83622025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
83632025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83642025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83652025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
83662025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83672025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
83682025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83692025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83702025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
83712025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83722025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83732025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
83742025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83752025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83762025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83772025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83782025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83792025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83802025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83812025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83822025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83832025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83842025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83852025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83862025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83872025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83882025-01-09T01:11:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83892025-01-09T01:11:16.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1520, tv_nsec: 363406139 } })
83902025-01-09T01:11:16.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1520, tv_nsec: 363483140 } })
83912025-01-09T01:11:16.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
83922025-01-09T01:11:16.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
83932025-01-09T01:11:16.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83942025-01-09T01:11:16.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83952025-01-09T01:11:16.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83962025-01-09T01:11:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.878181ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83972025-01-09T01:11:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83982025-01-09T01:11:16.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83992025-01-09T01:11:16.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84002025-01-09T01:11:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84012025-01-09T01:11:16.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84022025-01-09T01:11:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84032025-01-09T01:11:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84042025-01-09T01:11:16.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84052025-01-09T01:11:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84062025-01-09T01:11:16.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84072025-01-09T01:11:16.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.935786ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
84082025-01-09T01:11:16.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84092025-01-09T01:11:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84102025-01-09T01:11:16.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84112025-01-09T01:11:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84122025-01-09T01:11:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84132025-01-09T01:11:16.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84142025-01-09T01:11:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84152025-01-09T01:11:16.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84162025-01-09T01:11:16.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84172025-01-09T01:11:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84182025-01-09T01:11:16.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84192025-01-09T01:11:16.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84202025-01-09T01:11:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84212025-01-09T01:11:16.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84222025-01-09T01:11:16.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84232025-01-09T01:11:16.931ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84242025-01-09T01:11:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84252025-01-09T01:11:16.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84262025-01-09T01:11:16.933ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1520, tv_nsec: 393321273 } })
84272025-01-09T01:11:16.933ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
84282025-01-09T01:11:16.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
84292025-01-09T01:11:16.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84302025-01-09T01:11:16.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84312025-01-09T01:11:16.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84322025-01-09T01:11:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84332025-01-09T01:11:16.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84342025-01-09T01:11:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84352025-01-09T01:11:16.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.984252ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
84362025-01-09T01:11:16.952ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
84372025-01-09T01:11:16.952ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.198756ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
84382025-01-09T01:11:16.955ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84392025-01-09T01:11:16.955ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84402025-01-09T01:11:16.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84412025-01-09T01:11:16.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84422025-01-09T01:11:16.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84432025-01-09T01:11:16.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84442025-01-09T01:11:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84452025-01-09T01:11:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84462025-01-09T01:11:16.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84472025-01-09T01:11:16.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84482025-01-09T01:11:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84492025-01-09T01:11:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84502025-01-09T01:11:16.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84512025-01-09T01:11:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84522025-01-09T01:11:16.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84532025-01-09T01:11:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84542025-01-09T01:11:16.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 64.645548ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84552025-01-09T01:11:16.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84562025-01-09T01:11:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84572025-01-09T01:11:16.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.620211ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84582025-01-09T01:11:17.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84592025-01-09T01:11:17.001ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84602025-01-09T01:11:17.001ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc06d7cf-80e5-48a9-a92a-4fdff395d2bf", "content-length": "26", "date": "Thu, 09 Jan 2025 01:11:16 GMT"} })
84612025-01-09T01:11:17.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84622025-01-09T01:11:17.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84632025-01-09T01:11:17.041ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.074621ms iteration = 18 status = {"physical_disks_added":0}
84642025-01-09T01:11:17.059ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
84652025-01-09T01:11:17.059ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84662025-01-09T01:11:17.060ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd8b137a-1947-4e17-8b24-dd5d8ebf1c63", "content-length": "26", "date": "Thu, 09 Jan 2025 01:11:16 GMT"} })
84672025-01-09T01:11:17.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84682025-01-09T01:11:17.061ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
84692025-01-09T01:11:17.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84702025-01-09T01:11:17.108ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84712025-01-09T01:11:17.108ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a63d490-d466-44d7-816a-2896356bfe7a", "content-length": "26", "date": "Thu, 09 Jan 2025 01:11:16 GMT"} })
84722025-01-09T01:11:17.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84732025-01-09T01:11:17.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84742025-01-09T01:11:17.128ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84752025-01-09T01:11:17.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84762025-01-09T01:11:17.129ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.432897ms iteration = 16 status = {}
84772025-01-09T01:11:17.131ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84782025-01-09T01:11:17.131ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84792025-01-09T01:11:17.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84802025-01-09T01:11:17.131ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7c1558f-eeae-4a18-8dc8-00d135e1758a", "content-length": "372", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
84812025-01-09T01:11:17.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84822025-01-09T01:11:17.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84832025-01-09T01:11:17.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84842025-01-09T01:11:17.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84852025-01-09T01:11:17.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84862025-01-09T01:11:17.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84872025-01-09T01:11:17.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84882025-01-09T01:11:17.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84892025-01-09T01:11:17.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84902025-01-09T01:11:17.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 258.948912ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84912025-01-09T01:11:17.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84922025-01-09T01:11:17.161ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84932025-01-09T01:11:17.161ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84942025-01-09T01:11:17.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 260.239091ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84952025-01-09T01:11:17.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 261.667173ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84962025-01-09T01:11:17.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
84972025-01-09T01:11:17.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84982025-01-09T01:11:17.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84992025-01-09T01:11:17.165ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 264.336444ms iteration = 16 status = 0
85002025-01-09T01:11:17.170ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85012025-01-09T01:11:17.170ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 268.878287ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85022025-01-09T01:11:17.179ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
85032025-01-09T01:11:17.179ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85042025-01-09T01:11:17.180ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38d08a20-9d57-4c28-ac4b-6f168925fb34", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85052025-01-09T01:11:17.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85062025-01-09T01:11:17.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85072025-01-09T01:11:17.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85082025-01-09T01:11:17.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85092025-01-09T01:11:17.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85102025-01-09T01:11:17.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85112025-01-09T01:11:17.187ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85122025-01-09T01:11:17.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85132025-01-09T01:11:17.188ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85142025-01-09T01:11:17.188ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "497191db-8457-4c7b-ac89-8c8180a452f2", "content-length": "1", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85152025-01-09T01:11:17.189ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85162025-01-09T01:11:17.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85172025-01-09T01:11:17.192ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b188c461-9136-4906-922a-cc1310a5bba7", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85182025-01-09T01:11:17.192ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.322325ms iteration = 16 status = null
85192025-01-09T01:11:17.194ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.278557ms iteration = 16 status = {}
85202025-01-09T01:11:17.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85212025-01-09T01:11:17.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85222025-01-09T01:11:17.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85232025-01-09T01:11:17.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85242025-01-09T01:11:17.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85252025-01-09T01:11:17.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85262025-01-09T01:11:17.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85272025-01-09T01:11:17.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85282025-01-09T01:11:17.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85292025-01-09T01:11:17.235ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
85302025-01-09T01:11:17.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85312025-01-09T01:11:17.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85322025-01-09T01:11:17.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85332025-01-09T01:11:17.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85342025-01-09T01:11:17.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85352025-01-09T01:11:17.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85362025-01-09T01:11:17.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "51d77c42-8b3e-419c-855d-ad669216ced8", "content-length": "134", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85372025-01-09T01:11:17.245ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85382025-01-09T01:11:17.245ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
85392025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85402025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85412025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85422025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85432025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85442025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85452025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85462025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85472025-01-09T01:11:17.246ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
85482025-01-09T01:11:17.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85492025-01-09T01:11:17.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85502025-01-09T01:11:17.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85512025-01-09T01:11:17.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb8bf99f-0c82-482a-8ef0-ab8d5ffedc29", "content-length": "2", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85522025-01-09T01:11:17.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85532025-01-09T01:11:17.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "795bfc87-b50d-4d50-88e2-e4a5de16ea66", "content-length": "52", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85542025-01-09T01:11:17.249ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
85552025-01-09T01:11:17.249ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85562025-01-09T01:11:17.325ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85572025-01-09T01:11:17.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "649f3d21-d423-430d-983c-1b3369514c93", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85582025-01-09T01:11:17.349ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
85592025-01-09T01:11:17.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85602025-01-09T01:11:17.349ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b2e48b1-7340-49f0-b27e-d006fb45dfdb", "content-length": "691", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85612025-01-09T01:11:17.349ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85622025-01-09T01:11:17.349ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85632025-01-09T01:11:17.349ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85642025-01-09T01:11:17.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "376dcacf-0768-4645-93b8-2d45784ebf12", "content-length": "682", "date": "Thu, 09 Jan 2025 01:11:17 GMT"} })
85652025-01-09T01:11:17.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85662025-01-09T01:11:17.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85672025-01-09T01:11:17.351ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 450.699079ms iteration = 16 status = {}
85682025-01-09T01:11:17.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85692025-01-09T01:11:17.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85702025-01-09T01:11:17.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85712025-01-09T01:11:17.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85722025-01-09T01:11:17.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85732025-01-09T01:11:17.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85742025-01-09T01:11:17.366ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.903079ms iteration = 16 status = {}
85752025-01-09T01:11:17.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 923f5387-5901-427e-89e7-a0b9565a4495 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85762025-01-09T01:11:17.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 923f5387-5901-427e-89e7-a0b9565a4495 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85772025-01-09T01:11:17.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 923f5387-5901-427e-89e7-a0b9565a4495 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85782025-01-09T01:11:18.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6dc82b99-9591-4741-9e6f-b3544d05b62e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85792025-01-09T01:11:18.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6dc82b99-9591-4741-9e6f-b3544d05b62e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85802025-01-09T01:11:18.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6dc82b99-9591-4741-9e6f-b3544d05b62e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85812025-01-09T01:11:19.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f85c7480-62fe-4a87-8cb1-99d15e95ff35 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85822025-01-09T01:11:19.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f85c7480-62fe-4a87-8cb1-99d15e95ff35 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85832025-01-09T01:11:19.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f85c7480-62fe-4a87-8cb1-99d15e95ff35 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85842025-01-09T01:11:19.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 752 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 047a17e7-fe96-45fd-bad7-2f3252530648 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
85852025-01-09T01:11:20.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76ae19f8-37be-4922-96ab-cded55925d4c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85862025-01-09T01:11:20.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76ae19f8-37be-4922-96ab-cded55925d4c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85872025-01-09T01:11:20.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 76ae19f8-37be-4922-96ab-cded55925d4c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85882025-01-09T01:11:21.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 42c6cfcb-4715-4db4-bfb2-0485c4bb1764 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85892025-01-09T01:11:21.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 42c6cfcb-4715-4db4-bfb2-0485c4bb1764 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85902025-01-09T01:11:21.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 42c6cfcb-4715-4db4-bfb2-0485c4bb1764 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85912025-01-09T01:11:22.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb71e5cc-0f5b-4807-ae17-1862608c023c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85922025-01-09T01:11:22.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb71e5cc-0f5b-4807-ae17-1862608c023c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85932025-01-09T01:11:22.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bb71e5cc-0f5b-4807-ae17-1862608c023c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85942025-01-09T01:11:23.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0872eecb-427e-4280-9b5e-618e6094361b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85952025-01-09T01:11:23.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0872eecb-427e-4280-9b5e-618e6094361b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85962025-01-09T01:11:23.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0872eecb-427e-4280-9b5e-618e6094361b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85972025-01-09T01:11:24.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c125244-4e3e-474f-871c-459f3955ce32 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85982025-01-09T01:11:24.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c125244-4e3e-474f-871c-459f3955ce32 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
85992025-01-09T01:11:24.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c125244-4e3e-474f-871c-459f3955ce32 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86002025-01-09T01:11:25.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f56e0f9-df74-48cd-b6df-d38e75fc7a58 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86012025-01-09T01:11:25.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f56e0f9-df74-48cd-b6df-d38e75fc7a58 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86022025-01-09T01:11:25.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f56e0f9-df74-48cd-b6df-d38e75fc7a58 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86032025-01-09T01:11:26.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
86042025-01-09T01:11:26.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86052025-01-09T01:11:26.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
86062025-01-09T01:11:26.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86072025-01-09T01:11:26.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86082025-01-09T01:11:26.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86092025-01-09T01:11:26.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86102025-01-09T01:11:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86112025-01-09T01:11:26.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86122025-01-09T01:11:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86132025-01-09T01:11:26.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86142025-01-09T01:11:26.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86152025-01-09T01:11:26.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162025-01-09T01:11:26.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
86172025-01-09T01:11:26.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86182025-01-09T01:11:26.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86192025-01-09T01:11:26.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
86202025-01-09T01:11:26.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.042862ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
86212025-01-09T01:11:26.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86222025-01-09T01:11:26.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86232025-01-09T01:11:26.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.338637ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86242025-01-09T01:11:26.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0ec56ea5-daf6-4a13-89b0-2c565f09e0ae roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86252025-01-09T01:11:26.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0ec56ea5-daf6-4a13-89b0-2c565f09e0ae resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86262025-01-09T01:11:26.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0ec56ea5-daf6-4a13-89b0-2c565f09e0ae response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86272025-01-09T01:11:28.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab642866-e0a1-466f-b6a7-45ae565501e2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86282025-01-09T01:11:28.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab642866-e0a1-466f-b6a7-45ae565501e2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86292025-01-09T01:11:28.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab642866-e0a1-466f-b6a7-45ae565501e2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86302025-01-09T01:11:29.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bd4e8a1f-8dae-4620-8d21-88de2fdf27b9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86312025-01-09T01:11:29.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bd4e8a1f-8dae-4620-8d21-88de2fdf27b9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86322025-01-09T01:11:29.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bd4e8a1f-8dae-4620-8d21-88de2fdf27b9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86332025-01-09T01:11:29.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = ac8bc9c7-ecb8-4f9f-be3f-f02d698c04b6 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
86342025-01-09T01:11:30.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bebee17-d47a-4635-a080-06816ded950d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86352025-01-09T01:11:30.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bebee17-d47a-4635-a080-06816ded950d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86362025-01-09T01:11:30.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bebee17-d47a-4635-a080-06816ded950d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86372025-01-09T01:11:31.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 444f2f6d-4998-4ce5-a17b-6cf354d364a0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86382025-01-09T01:11:31.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 444f2f6d-4998-4ce5-a17b-6cf354d364a0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86392025-01-09T01:11:31.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 444f2f6d-4998-4ce5-a17b-6cf354d364a0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86402025-01-09T01:11:32.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26cf92d8-fc97-4474-a928-23b04d777394 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86412025-01-09T01:11:32.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26cf92d8-fc97-4474-a928-23b04d777394 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86422025-01-09T01:11:32.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26cf92d8-fc97-4474-a928-23b04d777394 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86432025-01-09T01:11:33.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6160dcac-87ac-41a3-b252-627ac5eeb694 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86442025-01-09T01:11:33.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6160dcac-87ac-41a3-b252-627ac5eeb694 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86452025-01-09T01:11:33.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6160dcac-87ac-41a3-b252-627ac5eeb694 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86462025-01-09T01:11:34.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27ae099a-374e-423c-b1ad-5e73f822a78e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86472025-01-09T01:11:34.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27ae099a-374e-423c-b1ad-5e73f822a78e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86482025-01-09T01:11:34.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27ae099a-374e-423c-b1ad-5e73f822a78e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86492025-01-09T01:11:35.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 18e35f17-aa75-488f-aa66-9c4c8f9898a0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86502025-01-09T01:11:35.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 18e35f17-aa75-488f-aa66-9c4c8f9898a0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86512025-01-09T01:11:35.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 18e35f17-aa75-488f-aa66-9c4c8f9898a0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86522025-01-09T01:11:36.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c1b650e9-d228-419f-9653-22f06dfb1522 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86532025-01-09T01:11:36.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c1b650e9-d228-419f-9653-22f06dfb1522 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86542025-01-09T01:11:36.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c1b650e9-d228-419f-9653-22f06dfb1522 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86552025-01-09T01:11:36.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
86562025-01-09T01:11:36.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86572025-01-09T01:11:36.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
86582025-01-09T01:11:36.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86592025-01-09T01:11:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86602025-01-09T01:11:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86612025-01-09T01:11:36.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86622025-01-09T01:11:36.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86632025-01-09T01:11:36.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86642025-01-09T01:11:36.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.142574ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86652025-01-09T01:11:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86662025-01-09T01:11:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86672025-01-09T01:11:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86682025-01-09T01:11:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86692025-01-09T01:11:36.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86702025-01-09T01:11:36.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86712025-01-09T01:11:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
86722025-01-09T01:11:36.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86732025-01-09T01:11:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86742025-01-09T01:11:36.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
86752025-01-09T01:11:36.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.200533ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
86762025-01-09T01:11:37.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0c33e054-ab88-42fd-af58-1ac45d4a0638 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86772025-01-09T01:11:37.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0c33e054-ab88-42fd-af58-1ac45d4a0638 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86782025-01-09T01:11:37.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0c33e054-ab88-42fd-af58-1ac45d4a0638 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86792025-01-09T01:11:38.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 71c54a61-0292-4d6c-8acb-5a33a98a28be roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86802025-01-09T01:11:38.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 71c54a61-0292-4d6c-8acb-5a33a98a28be resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86812025-01-09T01:11:38.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 71c54a61-0292-4d6c-8acb-5a33a98a28be response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86822025-01-09T01:11:39.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cfd1badd-c760-48be-894b-00257522df9f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86832025-01-09T01:11:39.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cfd1badd-c760-48be-894b-00257522df9f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86842025-01-09T01:11:39.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cfd1badd-c760-48be-894b-00257522df9f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86852025-01-09T01:11:39.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 685 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 94ddac77-368b-4aaa-a792-db6d12802cc4 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
86862025-01-09T01:11:40.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c11d66b1-73b8-4828-90c5-c2aacd4398d3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86872025-01-09T01:11:40.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c11d66b1-73b8-4828-90c5-c2aacd4398d3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86882025-01-09T01:11:40.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c11d66b1-73b8-4828-90c5-c2aacd4398d3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86892025-01-09T01:11:41.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 116b0e6b-8b38-479c-93ef-b0adf6ff4512 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86902025-01-09T01:11:41.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 116b0e6b-8b38-479c-93ef-b0adf6ff4512 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86912025-01-09T01:11:41.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 116b0e6b-8b38-479c-93ef-b0adf6ff4512 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86922025-01-09T01:11:42.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67618343-f811-4cd1-a58f-8baf65248677 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86932025-01-09T01:11:42.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67618343-f811-4cd1-a58f-8baf65248677 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86942025-01-09T01:11:42.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67618343-f811-4cd1-a58f-8baf65248677 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86952025-01-09T01:11:43.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7838238-6301-455a-baa5-3ae9608790e6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86962025-01-09T01:11:43.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7838238-6301-455a-baa5-3ae9608790e6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86972025-01-09T01:11:43.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7838238-6301-455a-baa5-3ae9608790e6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86982025-01-09T01:11:44.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26c0c938-4b8c-4b35-b249-801ab5c19678 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
86992025-01-09T01:11:44.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26c0c938-4b8c-4b35-b249-801ab5c19678 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87002025-01-09T01:11:44.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 26c0c938-4b8c-4b35-b249-801ab5c19678 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87012025-01-09T01:11:45.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 81fdee40-1578-474a-a4c9-1f4ef86dd29d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87022025-01-09T01:11:45.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 81fdee40-1578-474a-a4c9-1f4ef86dd29d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87032025-01-09T01:11:45.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 81fdee40-1578-474a-a4c9-1f4ef86dd29d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87042025-01-09T01:11:46.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 08027c2b-2aa2-479d-b32d-37d1b979c569 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87052025-01-09T01:11:46.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 08027c2b-2aa2-479d-b32d-37d1b979c569 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87062025-01-09T01:11:46.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 08027c2b-2aa2-479d-b32d-37d1b979c569 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
87072025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
87082025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87092025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
87102025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87112025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87122025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
87132025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87142025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
87152025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87162025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
87172025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87182025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
87192025-01-09T01:11:46.900ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:01:46.900419373 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87202025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
87212025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87222025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
87232025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87242025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
87252025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
87262025-01-09T01:11:46.900ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
87272025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87282025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
87292025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87302025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87312025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
87322025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87332025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
87342025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87352025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
87362025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87372025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
87382025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
87392025-01-09T01:11:46.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87402025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
87412025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87422025-01-09T01:11:46.900ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
87432025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87442025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.12\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
87452025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
87462025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
87472025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87482025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
87492025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87502025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
87512025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
87522025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87532025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
87542025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87552025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87562025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
87572025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87582025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
87592025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87602025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
87612025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87622025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
87632025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
87642025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87652025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
87662025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87672025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
87682025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87692025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87702025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87712025-01-09T01:11:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87722025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87732025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87742025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87752025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87762025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87772025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87782025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87792025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87802025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87812025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87822025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87832025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87842025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87852025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87862025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87872025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87882025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87892025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87902025-01-09T01:11:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 361027915 } })
87912025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87922025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87932025-01-09T01:11:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 361081006 } })
87942025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87952025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
87962025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.110075ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
87972025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
87982025-01-09T01:11:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.524074ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
87992025-01-09T01:11:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88002025-01-09T01:11:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88012025-01-09T01:11:46.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.579081ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
88022025-01-09T01:11:46.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 363730976 } })
88032025-01-09T01:11:46.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88042025-01-09T01:11:46.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88052025-01-09T01:11:46.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88062025-01-09T01:11:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88072025-01-09T01:11:46.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88082025-01-09T01:11:46.905ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88092025-01-09T01:11:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.995763ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88102025-01-09T01:11:46.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:01:46.900419373 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88112025-01-09T01:11:46.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.74674ms iteration = 9 status = {"expiration":"2025-01-09T01:01:46.900419373Z","pruned":[]}
88122025-01-09T01:11:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
88132025-01-09T01:11:46.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88142025-01-09T01:11:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88152025-01-09T01:11:46.907ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88162025-01-09T01:11:46.907ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88172025-01-09T01:11:46.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88182025-01-09T01:11:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88192025-01-09T01:11:46.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88202025-01-09T01:11:46.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88212025-01-09T01:11:46.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88222025-01-09T01:11:46.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88232025-01-09T01:11:46.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88242025-01-09T01:11:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88252025-01-09T01:11:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88262025-01-09T01:11:46.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88272025-01-09T01:11:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88282025-01-09T01:11:46.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88292025-01-09T01:11:46.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88302025-01-09T01:11:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88312025-01-09T01:11:46.915ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.658571ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
88322025-01-09T01:11:46.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88332025-01-09T01:11:46.918ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 378276874 } })
88342025-01-09T01:11:46.918ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
88352025-01-09T01:11:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88362025-01-09T01:11:46.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88372025-01-09T01:11:46.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88382025-01-09T01:11:46.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88392025-01-09T01:11:46.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88402025-01-09T01:11:46.926ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88412025-01-09T01:11:46.926ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88422025-01-09T01:11:46.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88432025-01-09T01:11:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88442025-01-09T01:11:46.929ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 388806892 } })
88452025-01-09T01:11:46.930ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
88462025-01-09T01:11:46.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88472025-01-09T01:11:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88482025-01-09T01:11:46.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88492025-01-09T01:11:46.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88502025-01-09T01:11:46.959ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88512025-01-09T01:11:46.959ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88522025-01-09T01:11:46.959ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.985571ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88532025-01-09T01:11:46.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542025-01-09T01:11:46.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88552025-01-09T01:11:46.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88562025-01-09T01:11:46.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572025-01-09T01:11:46.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88582025-01-09T01:11:46.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88592025-01-09T01:11:46.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88602025-01-09T01:11:46.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88612025-01-09T01:11:46.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88622025-01-09T01:11:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88632025-01-09T01:11:46.966ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88642025-01-09T01:11:46.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88652025-01-09T01:11:46.967ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88662025-01-09T01:11:46.967ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88672025-01-09T01:11:46.967ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.35029ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88682025-01-09T01:11:46.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88692025-01-09T01:11:46.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88702025-01-09T01:11:46.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.38337ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
88712025-01-09T01:11:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88722025-01-09T01:11:46.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88732025-01-09T01:11:46.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.912375ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88742025-01-09T01:11:46.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88752025-01-09T01:11:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88762025-01-09T01:11:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88772025-01-09T01:11:46.970ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88782025-01-09T01:11:46.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88792025-01-09T01:11:46.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88802025-01-09T01:11:46.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88812025-01-09T01:11:46.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88822025-01-09T01:11:46.972ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.976714ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88832025-01-09T01:11:46.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88842025-01-09T01:11:46.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88852025-01-09T01:11:46.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88862025-01-09T01:11:46.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88872025-01-09T01:11:46.976ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88882025-01-09T01:11:46.976ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88892025-01-09T01:11:46.976ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88902025-01-09T01:11:46.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88912025-01-09T01:11:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88922025-01-09T01:11:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
88932025-01-09T01:11:46.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88942025-01-09T01:11:46.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88952025-01-09T01:11:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88962025-01-09T01:11:46.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88972025-01-09T01:11:46.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88982025-01-09T01:11:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88992025-01-09T01:11:46.984ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89002025-01-09T01:11:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89012025-01-09T01:11:46.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89022025-01-09T01:11:46.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89032025-01-09T01:11:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89042025-01-09T01:11:46.986ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.282657ms iteration = 17 status = 0
89052025-01-09T01:11:46.987ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89062025-01-09T01:11:46.987ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89072025-01-09T01:11:46.987ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.415872ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89082025-01-09T01:11:46.992ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89092025-01-09T01:11:46.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89102025-01-09T01:11:46.994ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89112025-01-09T01:11:46.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89122025-01-09T01:11:47.012ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89132025-01-09T01:11:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89142025-01-09T01:11:47.013ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89152025-01-09T01:11:47.013ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89162025-01-09T01:11:47.013ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89172025-01-09T01:11:47.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89182025-01-09T01:11:47.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89192025-01-09T01:11:47.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.357191ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89202025-01-09T01:11:47.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89212025-01-09T01:11:47.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89222025-01-09T01:11:47.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89232025-01-09T01:11:47.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89242025-01-09T01:11:47.023ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89252025-01-09T01:11:47.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 123.243601ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89262025-01-09T01:11:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
89272025-01-09T01:11:47.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89282025-01-09T01:11:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89292025-01-09T01:11:47.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89302025-01-09T01:11:47.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89312025-01-09T01:11:47.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89322025-01-09T01:11:47.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89332025-01-09T01:11:47.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89342025-01-09T01:11:47.038ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89352025-01-09T01:11:47.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89362025-01-09T01:11:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89372025-01-09T01:11:47.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89382025-01-09T01:11:47.063ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89392025-01-09T01:11:47.063ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89402025-01-09T01:11:47.063ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "571da59f-0378-4b16-960d-3a0a201aae1b", "content-length": "26", "date": "Thu, 09 Jan 2025 01:11:46 GMT"} })
89412025-01-09T01:11:47.063ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89422025-01-09T01:11:47.065ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89432025-01-09T01:11:47.083ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89442025-01-09T01:11:47.083ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89452025-01-09T01:11:47.083ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bf915cf-a1b3-4cb7-84aa-5b9468f76c30", "content-length": "26", "date": "Thu, 09 Jan 2025 01:11:46 GMT"} })
89462025-01-09T01:11:47.083ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89472025-01-09T01:11:47.085ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89482025-01-09T01:11:47.113ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.287143ms iteration = 19 status = {"physical_disks_added":0}
89492025-01-09T01:11:47.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
89502025-01-09T01:11:47.132ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89512025-01-09T01:11:47.132ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c9e38e9-f9a4-46fe-9e09-b77e8e714517", "content-length": "26", "date": "Thu, 09 Jan 2025 01:11:46 GMT"} })
89522025-01-09T01:11:47.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89532025-01-09T01:11:47.134ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
89542025-01-09T01:11:47.194ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89552025-01-09T01:11:47.195ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89562025-01-09T01:11:47.195ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eb66d07-1c32-48ff-8d82-190f94f85c68", "content-length": "372", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
89572025-01-09T01:11:47.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89582025-01-09T01:11:47.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89592025-01-09T01:11:47.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 297.40459ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
89602025-01-09T01:11:47.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612025-01-09T01:11:47.202ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89622025-01-09T01:11:47.202ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ed06fcc5-a8f5-4f21-80e7-589c07e74d57", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89632025-01-09T01:11:47.202ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89642025-01-09T01:11:47.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89652025-01-09T01:11:47.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89662025-01-09T01:11:47.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89672025-01-09T01:11:47.204ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b1b7003d-2c8c-4d79-aa42-53341a75c45f", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89682025-01-09T01:11:47.204ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89692025-01-09T01:11:47.206ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89702025-01-09T01:11:47.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 306.210879ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89712025-01-09T01:11:47.213ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
89722025-01-09T01:11:47.213ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 312.456549ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
89732025-01-09T01:11:47.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89742025-01-09T01:11:47.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89752025-01-09T01:11:47.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89762025-01-09T01:11:47.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89772025-01-09T01:11:47.236ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89782025-01-09T01:11:47.236ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
89792025-01-09T01:11:47.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89802025-01-09T01:11:47.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89812025-01-09T01:11:47.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89822025-01-09T01:11:47.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89832025-01-09T01:11:47.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89842025-01-09T01:11:47.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89852025-01-09T01:11:47.249ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
89862025-01-09T01:11:47.249ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 348.886361ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89872025-01-09T01:11:47.251ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
89882025-01-09T01:11:47.251ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89892025-01-09T01:11:47.251ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
89902025-01-09T01:11:47.251ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 351.269826ms iteration = 9 status = {"generation":2}
89912025-01-09T01:11:47.252ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89922025-01-09T01:11:47.254ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 354.500399ms iteration = 17 status = {}
89932025-01-09T01:11:47.259ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89942025-01-09T01:11:47.259ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89952025-01-09T01:11:47.269ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89962025-01-09T01:11:47.269ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89972025-01-09T01:11:47.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89982025-01-09T01:11:47.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89992025-01-09T01:11:47.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90002025-01-09T01:11:47.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90012025-01-09T01:11:47.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90022025-01-09T01:11:47.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90032025-01-09T01:11:47.276ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90042025-01-09T01:11:47.276ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90052025-01-09T01:11:47.276ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
90062025-01-09T01:11:47.276ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 376.026834ms iteration = 9 status = {"generation":1}
90072025-01-09T01:11:47.298ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90082025-01-09T01:11:47.299ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "147619c4-41f0-4738-a017-bd6ff464f9a5", "content-length": "1", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90092025-01-09T01:11:47.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90102025-01-09T01:11:47.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90112025-01-09T01:11:47.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90122025-01-09T01:11:47.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90132025-01-09T01:11:47.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90142025-01-09T01:11:47.303ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 403.117585ms iteration = 17 status = null
90152025-01-09T01:11:47.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90162025-01-09T01:11:47.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90172025-01-09T01:11:47.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90182025-01-09T01:11:47.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90192025-01-09T01:11:47.308ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90202025-01-09T01:11:47.308ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 407.624567ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90212025-01-09T01:11:47.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90222025-01-09T01:11:47.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90232025-01-09T01:11:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90242025-01-09T01:11:47.330ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90252025-01-09T01:11:47.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "aacedaa9-0d6b-4d98-bc44-d885e7bfaf28", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90262025-01-09T01:11:47.330ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90272025-01-09T01:11:47.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a3d6501b-89ea-4b5b-81fd-10e289e9a10d", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90282025-01-09T01:11:47.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90292025-01-09T01:11:47.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "038ae3a1-5a57-4a6e-b72c-1c3bf2ae7648", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90302025-01-09T01:11:47.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90312025-01-09T01:11:47.336ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
90322025-01-09T01:11:47.336ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.11871ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90332025-01-09T01:11:47.351ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a19aae06-6ee6-44bd-ae61-a629cc66a905", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90342025-01-09T01:11:47.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90352025-01-09T01:11:47.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90362025-01-09T01:11:47.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90372025-01-09T01:11:47.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90382025-01-09T01:11:47.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90392025-01-09T01:11:47.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90402025-01-09T01:11:47.361ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90412025-01-09T01:11:47.361ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90422025-01-09T01:11:47.362ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2c54f09d-faef-489b-ad26-b284b813fc3c", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90432025-01-09T01:11:47.363ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 463.19068ms iteration = 17 status = {}
90442025-01-09T01:11:47.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90452025-01-09T01:11:47.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90462025-01-09T01:11:47.420ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
90472025-01-09T01:11:47.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90482025-01-09T01:11:47.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90492025-01-09T01:11:47.426ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90502025-01-09T01:11:47.426ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3568ac0-5f42-450b-bb5e-2a238fa9375e", "content-length": "691", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90512025-01-09T01:11:47.426ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90522025-01-09T01:11:47.426ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90532025-01-09T01:11:47.426ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90542025-01-09T01:11:47.428ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 527.467389ms iteration = 17 status = {}
90552025-01-09T01:11:47.435ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90562025-01-09T01:11:47.435ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ce2ab62-fdfd-4a80-81ad-9fdc7c1a16bc", "content-length": "134", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90572025-01-09T01:11:47.435ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90582025-01-09T01:11:47.435ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
90592025-01-09T01:11:47.435ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90602025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90612025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90622025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90632025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90642025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90652025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90662025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90672025-01-09T01:11:47.436ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
90682025-01-09T01:11:47.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90692025-01-09T01:11:47.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90702025-01-09T01:11:47.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8019032d-d673-4794-b563-0bc9f0518ec3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90712025-01-09T01:11:47.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8019032d-d673-4794-b563-0bc9f0518ec3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90722025-01-09T01:11:47.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90732025-01-09T01:11:47.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "eca9dd2a-9b3f-4184-93f3-7496d9aaa0f9", "content-length": "2", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90742025-01-09T01:11:47.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90752025-01-09T01:11:47.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a777ec09-10d4-4ced-ab2b-83b7ab3fbaf1", "content-length": "52", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90762025-01-09T01:11:47.438ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
90772025-01-09T01:11:47.438ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90782025-01-09T01:11:47.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8019032d-d673-4794-b563-0bc9f0518ec3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90792025-01-09T01:11:47.554ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8f3aa78e-c4d2-49f7-bc9c-b0ab24bb7cd6", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90802025-01-09T01:11:47.554ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
90812025-01-09T01:11:47.554ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90822025-01-09T01:11:47.554ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9349243c-2e76-4306-a005-bf1968de57db", "content-length": "682", "date": "Thu, 09 Jan 2025 01:11:47 GMT"} })
90832025-01-09T01:11:47.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90842025-01-09T01:11:47.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90852025-01-09T01:11:47.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90862025-01-09T01:11:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90872025-01-09T01:11:47.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90882025-01-09T01:11:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90892025-01-09T01:11:47.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90902025-01-09T01:11:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90912025-01-09T01:11:47.570ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 670.011696ms iteration = 17 status = {}
90922025-01-09T01:11:48.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = db45ce4f-2195-4559-9d9c-0850f0bd0da9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90932025-01-09T01:11:48.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = db45ce4f-2195-4559-9d9c-0850f0bd0da9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90942025-01-09T01:11:48.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = db45ce4f-2195-4559-9d9c-0850f0bd0da9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90952025-01-09T01:11:49.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3ffc495-df9d-477f-9380-59edc288909e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90962025-01-09T01:11:49.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3ffc495-df9d-477f-9380-59edc288909e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90972025-01-09T01:11:49.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f3ffc495-df9d-477f-9380-59edc288909e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
90982025-01-09T01:11:49.941ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 303fdf42-790d-404e-b2bf-9ac32b239d07 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
90992025-01-09T01:11:50.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a844303f-18c8-4bc9-937d-8b0b32a81880 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91002025-01-09T01:11:50.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a844303f-18c8-4bc9-937d-8b0b32a81880 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91012025-01-09T01:11:50.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a844303f-18c8-4bc9-937d-8b0b32a81880 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91022025-01-09T01:11:51.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85dbb6bf-2e6f-46ca-97be-ee152e7a6d70 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91032025-01-09T01:11:51.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85dbb6bf-2e6f-46ca-97be-ee152e7a6d70 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91042025-01-09T01:11:51.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85dbb6bf-2e6f-46ca-97be-ee152e7a6d70 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91052025-01-09T01:11:52.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5e8e1616-5d91-49d3-bedc-dce41b2d1107 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91062025-01-09T01:11:52.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5e8e1616-5d91-49d3-bedc-dce41b2d1107 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91072025-01-09T01:11:52.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5e8e1616-5d91-49d3-bedc-dce41b2d1107 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91082025-01-09T01:11:53.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = db3d9007-b46f-4c32-a3d8-c82d72e7f8c9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91092025-01-09T01:11:53.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = db3d9007-b46f-4c32-a3d8-c82d72e7f8c9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91102025-01-09T01:11:53.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = db3d9007-b46f-4c32-a3d8-c82d72e7f8c9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91112025-01-09T01:11:54.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4636755e-4561-4a2b-ad98-37fb92162eee roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91122025-01-09T01:11:54.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4636755e-4561-4a2b-ad98-37fb92162eee resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91132025-01-09T01:11:54.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4636755e-4561-4a2b-ad98-37fb92162eee response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91142025-01-09T01:11:55.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b19f1a3f-cf2a-4a38-b6f9-5b9f51924ac2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91152025-01-09T01:11:55.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b19f1a3f-cf2a-4a38-b6f9-5b9f51924ac2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91162025-01-09T01:11:55.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b19f1a3f-cf2a-4a38-b6f9-5b9f51924ac2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91172025-01-09T01:11:56.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f607aee8-bb3e-413c-9b3c-c5d8a2e41f8b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91182025-01-09T01:11:56.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f607aee8-bb3e-413c-9b3c-c5d8a2e41f8b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91192025-01-09T01:11:56.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f607aee8-bb3e-413c-9b3c-c5d8a2e41f8b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91202025-01-09T01:11:56.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
91212025-01-09T01:11:56.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
91222025-01-09T01:11:56.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91232025-01-09T01:11:56.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91242025-01-09T01:11:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91252025-01-09T01:11:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91262025-01-09T01:11:56.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272025-01-09T01:11:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91282025-01-09T01:11:56.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91292025-01-09T01:11:56.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91302025-01-09T01:11:56.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91312025-01-09T01:11:56.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91322025-01-09T01:11:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91332025-01-09T01:11:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
91342025-01-09T01:11:56.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91352025-01-09T01:11:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91362025-01-09T01:11:56.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
91372025-01-09T01:11:56.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.425056ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
91382025-01-09T01:11:56.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91392025-01-09T01:11:56.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91402025-01-09T01:11:56.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.275545ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91412025-01-09T01:11:57.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 781cc835-d6e3-46f7-b686-66f5bfbd0ac3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91422025-01-09T01:11:57.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 781cc835-d6e3-46f7-b686-66f5bfbd0ac3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91432025-01-09T01:11:57.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 781cc835-d6e3-46f7-b686-66f5bfbd0ac3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91442025-01-09T01:11:58.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 905cde75-9c6e-480e-96c6-839f73ad4528 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91452025-01-09T01:11:58.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 905cde75-9c6e-480e-96c6-839f73ad4528 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91462025-01-09T01:11:58.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 905cde75-9c6e-480e-96c6-839f73ad4528 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91472025-01-09T01:11:59.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a13b80f-0478-4dd4-bfef-84b1b7cd5bb8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91482025-01-09T01:11:59.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a13b80f-0478-4dd4-bfef-84b1b7cd5bb8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91492025-01-09T01:11:59.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a13b80f-0478-4dd4-bfef-84b1b7cd5bb8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91502025-01-09T01:11:59.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = dafce6a1-d586-451d-a384-4cac143e3623 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
91512025-01-09T01:12:00.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55c9a89e-541e-404c-8f54-537e8d06f0e2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91522025-01-09T01:12:00.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55c9a89e-541e-404c-8f54-537e8d06f0e2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91532025-01-09T01:12:00.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 55c9a89e-541e-404c-8f54-537e8d06f0e2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91542025-01-09T01:12:01.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4aeb23a6-98ce-4551-bd89-d17244af525f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91552025-01-09T01:12:01.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4aeb23a6-98ce-4551-bd89-d17244af525f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91562025-01-09T01:12:01.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4aeb23a6-98ce-4551-bd89-d17244af525f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91572025-01-09T01:12:02.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e21352e-6847-4f8c-926d-e4072598a65d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91582025-01-09T01:12:02.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e21352e-6847-4f8c-926d-e4072598a65d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91592025-01-09T01:12:02.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e21352e-6847-4f8c-926d-e4072598a65d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91602025-01-09T01:12:03.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e1be0e43-6875-4c40-a9b6-c775009191d4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91612025-01-09T01:12:03.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e1be0e43-6875-4c40-a9b6-c775009191d4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91622025-01-09T01:12:03.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e1be0e43-6875-4c40-a9b6-c775009191d4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91632025-01-09T01:12:04.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b140808-68c8-4822-ad10-baa54bd7e78c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91642025-01-09T01:12:04.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b140808-68c8-4822-ad10-baa54bd7e78c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91652025-01-09T01:12:04.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b140808-68c8-4822-ad10-baa54bd7e78c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91662025-01-09T01:12:05.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 779b0655-aca4-4975-9b6d-25830a0b5078 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91672025-01-09T01:12:05.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 779b0655-aca4-4975-9b6d-25830a0b5078 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91682025-01-09T01:12:05.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 779b0655-aca4-4975-9b6d-25830a0b5078 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91692025-01-09T01:12:06.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5b090a9e-ef41-4b6a-bd9a-7f430cfeb43b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91702025-01-09T01:12:06.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5b090a9e-ef41-4b6a-bd9a-7f430cfeb43b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91712025-01-09T01:12:06.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5b090a9e-ef41-4b6a-bd9a-7f430cfeb43b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91722025-01-09T01:12:06.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
91732025-01-09T01:12:06.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91742025-01-09T01:12:06.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
91752025-01-09T01:12:06.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91762025-01-09T01:12:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91772025-01-09T01:12:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91782025-01-09T01:12:06.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91792025-01-09T01:12:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91802025-01-09T01:12:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91812025-01-09T01:12:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91822025-01-09T01:12:06.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91832025-01-09T01:12:06.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91842025-01-09T01:12:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91852025-01-09T01:12:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
91862025-01-09T01:12:06.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91872025-01-09T01:12:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91882025-01-09T01:12:06.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
91892025-01-09T01:12:06.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.632118ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
91902025-01-09T01:12:06.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91912025-01-09T01:12:06.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91922025-01-09T01:12:06.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.820589ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91932025-01-09T01:12:07.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5649ce74-ec6e-490d-b6aa-300db8f9b1c8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91942025-01-09T01:12:07.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5649ce74-ec6e-490d-b6aa-300db8f9b1c8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91952025-01-09T01:12:07.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5649ce74-ec6e-490d-b6aa-300db8f9b1c8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91962025-01-09T01:12:08.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bf72c77-7871-4d4f-87e0-0cb0a015f3e4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91972025-01-09T01:12:08.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bf72c77-7871-4d4f-87e0-0cb0a015f3e4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91982025-01-09T01:12:08.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bf72c77-7871-4d4f-87e0-0cb0a015f3e4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
91992025-01-09T01:12:09.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 66b5277c-6a86-46cf-851c-45de1aeeb96d response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
92002025-01-09T01:12:09.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8b0c537a-b9d3-4214-a9e2-c6f0df399ef5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92012025-01-09T01:12:09.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8b0c537a-b9d3-4214-a9e2-c6f0df399ef5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92022025-01-09T01:12:09.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8b0c537a-b9d3-4214-a9e2-c6f0df399ef5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92032025-01-09T01:12:10.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 24f0ca83-161f-4ebd-8033-cf247e74f7f0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92042025-01-09T01:12:10.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 24f0ca83-161f-4ebd-8033-cf247e74f7f0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92052025-01-09T01:12:10.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 24f0ca83-161f-4ebd-8033-cf247e74f7f0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92062025-01-09T01:12:11.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bc983c46-6c63-4ab7-9301-506690674517 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92072025-01-09T01:12:11.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bc983c46-6c63-4ab7-9301-506690674517 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92082025-01-09T01:12:11.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bc983c46-6c63-4ab7-9301-506690674517 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92092025-01-09T01:12:13.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c1a406b6-a4d6-406a-8037-37b391c63fff roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92102025-01-09T01:12:13.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c1a406b6-a4d6-406a-8037-37b391c63fff resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92112025-01-09T01:12:13.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c1a406b6-a4d6-406a-8037-37b391c63fff response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92122025-01-09T01:12:14.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a080beb-cdba-441b-811b-4a6089af5cbe roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92132025-01-09T01:12:14.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a080beb-cdba-441b-811b-4a6089af5cbe resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92142025-01-09T01:12:14.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a080beb-cdba-441b-811b-4a6089af5cbe response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92152025-01-09T01:12:15.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d690c90c-758c-4526-8452-e60ecfda107b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92162025-01-09T01:12:15.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d690c90c-758c-4526-8452-e60ecfda107b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92172025-01-09T01:12:15.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d690c90c-758c-4526-8452-e60ecfda107b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92182025-01-09T01:12:16.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e858d9ce-fa47-4e0c-8bf7-caef7eea4491 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92192025-01-09T01:12:16.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e858d9ce-fa47-4e0c-8bf7-caef7eea4491 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92202025-01-09T01:12:16.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e858d9ce-fa47-4e0c-8bf7-caef7eea4491 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
92212025-01-09T01:12:16.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
92222025-01-09T01:12:16.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92232025-01-09T01:12:16.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
92242025-01-09T01:12:16.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92252025-01-09T01:12:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92262025-01-09T01:12:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92272025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
92282025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92292025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
92302025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
92312025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92322025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92332025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
92342025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92352025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92362025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92372025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92382025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92392025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
92402025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92412025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92422025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
92432025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92442025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
92452025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
92462025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92472025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92482025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
92492025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92502025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
92512025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92522025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
92532025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92542025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
92552025-01-09T01:12:16.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92562025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92572025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
92582025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92592025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92602025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92612025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92622025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92632025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92642025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92652025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92662025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92672025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92682025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92692025-01-09T01:12:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92702025-01-09T01:12:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92712025-01-09T01:12:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92722025-01-09T01:12:16.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1580, tv_nsec: 362683775 } })
92732025-01-09T01:12:16.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92742025-01-09T01:12:16.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1580, tv_nsec: 363088745 } })
92752025-01-09T01:12:16.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92762025-01-09T01:12:16.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92772025-01-09T01:12:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.640192ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92782025-01-09T01:12:16.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92792025-01-09T01:12:16.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92802025-01-09T01:12:16.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92812025-01-09T01:12:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92822025-01-09T01:12:16.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92832025-01-09T01:12:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92842025-01-09T01:12:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92852025-01-09T01:12:16.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92862025-01-09T01:12:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92872025-01-09T01:12:16.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92882025-01-09T01:12:16.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92892025-01-09T01:12:16.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92902025-01-09T01:12:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92912025-01-09T01:12:16.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92922025-01-09T01:12:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92932025-01-09T01:12:16.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92942025-01-09T01:12:16.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92952025-01-09T01:12:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92962025-01-09T01:12:16.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92972025-01-09T01:12:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92982025-01-09T01:12:16.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92992025-01-09T01:12:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93002025-01-09T01:12:16.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93012025-01-09T01:12:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93022025-01-09T01:12:16.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93032025-01-09T01:12:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93042025-01-09T01:12:16.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93052025-01-09T01:12:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93062025-01-09T01:12:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93072025-01-09T01:12:16.918ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1580, tv_nsec: 377990091 } })
93082025-01-09T01:12:16.918ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
93092025-01-09T01:12:16.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93102025-01-09T01:12:16.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93112025-01-09T01:12:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93122025-01-09T01:12:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
93132025-01-09T01:12:16.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93142025-01-09T01:12:16.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93152025-01-09T01:12:16.944ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93162025-01-09T01:12:16.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93172025-01-09T01:12:16.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.609439ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
93182025-01-09T01:12:16.947ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
93192025-01-09T01:12:16.947ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.743441ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
93202025-01-09T01:12:16.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93212025-01-09T01:12:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93222025-01-09T01:12:16.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.904971ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
93232025-01-09T01:12:16.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93242025-01-09T01:12:16.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93252025-01-09T01:12:16.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93262025-01-09T01:12:16.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93272025-01-09T01:12:16.960ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93282025-01-09T01:12:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93292025-01-09T01:12:16.961ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93302025-01-09T01:12:16.961ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93312025-01-09T01:12:16.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93322025-01-09T01:12:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93332025-01-09T01:12:16.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93342025-01-09T01:12:16.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93352025-01-09T01:12:16.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93362025-01-09T01:12:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
93372025-01-09T01:12:16.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93382025-01-09T01:12:16.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93392025-01-09T01:12:16.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93402025-01-09T01:12:16.969ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.687507ms iteration = 18 status = 0
93412025-01-09T01:12:16.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93422025-01-09T01:12:16.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93432025-01-09T01:12:16.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93442025-01-09T01:12:16.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93452025-01-09T01:12:16.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93462025-01-09T01:12:16.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93472025-01-09T01:12:16.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93482025-01-09T01:12:16.979ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93492025-01-09T01:12:16.979ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.46085ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93502025-01-09T01:12:16.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.716237ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93512025-01-09T01:12:16.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.73849ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93522025-01-09T01:12:16.999ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93532025-01-09T01:12:16.999ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93542025-01-09T01:12:16.999ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ee2433-5563-4331-916e-10e9717f45b8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
93552025-01-09T01:12:16.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93562025-01-09T01:12:17.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93572025-01-09T01:12:17.009ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93582025-01-09T01:12:17.009ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93592025-01-09T01:12:17.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93602025-01-09T01:12:17.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.780941ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93612025-01-09T01:12:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93622025-01-09T01:12:17.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.471113ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93632025-01-09T01:12:17.024ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
93642025-01-09T01:12:17.024ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93652025-01-09T01:12:17.024ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "550fa4d3-2dc7-4d6d-a55a-beb144e29b93", "content-length": "26", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
93662025-01-09T01:12:17.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93672025-01-09T01:12:17.026ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
93682025-01-09T01:12:17.038ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93692025-01-09T01:12:17.038ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93702025-01-09T01:12:17.038ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00283ae6-4439-4f6d-9746-c1834f582327", "content-length": "26", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
93712025-01-09T01:12:17.038ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93722025-01-09T01:12:17.040ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93732025-01-09T01:12:17.043ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93742025-01-09T01:12:17.043ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93752025-01-09T01:12:17.043ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.910732ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93762025-01-09T01:12:17.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93772025-01-09T01:12:17.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93782025-01-09T01:12:17.083ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.73146ms iteration = 20 status = {"physical_disks_added":0}
93792025-01-09T01:12:17.093ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93802025-01-09T01:12:17.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93812025-01-09T01:12:17.093ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "752c5c99-6954-458e-be60-a24c27f086ab", "content-length": "372", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
93822025-01-09T01:12:17.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93832025-01-09T01:12:17.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93842025-01-09T01:12:17.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bbb0aefa-9646-4f15-a52c-bcaef46d2971 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
93852025-01-09T01:12:17.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bbb0aefa-9646-4f15-a52c-bcaef46d2971 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
93862025-01-09T01:12:17.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bbb0aefa-9646-4f15-a52c-bcaef46d2971 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
93872025-01-09T01:12:17.121ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93882025-01-09T01:12:17.121ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c5c5d63-28bd-436f-96d3-7340c9ec1729", "content-length": "1", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
93892025-01-09T01:12:17.122ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93902025-01-09T01:12:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93912025-01-09T01:12:17.125ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.043737ms iteration = 18 status = null
93922025-01-09T01:12:17.138ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93932025-01-09T01:12:17.138ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93942025-01-09T01:12:17.139ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d208631d-7f94-4f4c-88cf-5f82571ab360", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
93952025-01-09T01:12:17.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93962025-01-09T01:12:17.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93972025-01-09T01:12:17.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93982025-01-09T01:12:17.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93992025-01-09T01:12:17.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94002025-01-09T01:12:17.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94012025-01-09T01:12:17.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94022025-01-09T01:12:17.144ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 243.671778ms iteration = 18 status = {}
94032025-01-09T01:12:17.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94042025-01-09T01:12:17.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94052025-01-09T01:12:17.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94062025-01-09T01:12:17.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94072025-01-09T01:12:17.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94082025-01-09T01:12:17.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94092025-01-09T01:12:17.148ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94102025-01-09T01:12:17.148ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94112025-01-09T01:12:17.149ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e9599602-17bf-4f79-a8c4-306086910b88", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
94122025-01-09T01:12:17.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94132025-01-09T01:12:17.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94142025-01-09T01:12:17.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94152025-01-09T01:12:17.150ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.241833ms iteration = 18 status = {}
94162025-01-09T01:12:17.191ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94172025-01-09T01:12:17.191ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5795d1dc-a767-475e-b666-15ae6a74c432", "content-length": "691", "date": "Thu, 09 Jan 2025 01:12:16 GMT"} })
94182025-01-09T01:12:17.191ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94192025-01-09T01:12:17.191ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94202025-01-09T01:12:17.191ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94212025-01-09T01:12:17.193ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 291.959437ms iteration = 18 status = {}
94222025-01-09T01:12:17.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94232025-01-09T01:12:17.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94242025-01-09T01:12:17.206ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
94252025-01-09T01:12:17.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94262025-01-09T01:12:17.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94272025-01-09T01:12:17.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94282025-01-09T01:12:17.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "96cba185-7f47-4c9c-b823-0d72acc5948a", "content-length": "134", "date": "Thu, 09 Jan 2025 01:12:17 GMT"} })
94292025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94302025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
94312025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94322025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94332025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94342025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94352025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94362025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94372025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94382025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94392025-01-09T01:12:17.217ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
94402025-01-09T01:12:17.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94412025-01-09T01:12:17.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94422025-01-09T01:12:17.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94432025-01-09T01:12:17.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2b98130-5728-4e69-a4e6-05f7f2d6764e", "content-length": "2", "date": "Thu, 09 Jan 2025 01:12:17 GMT"} })
94442025-01-09T01:12:17.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94452025-01-09T01:12:17.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c8903ce-9860-4aa7-9c1b-829020e079e0", "content-length": "52", "date": "Thu, 09 Jan 2025 01:12:17 GMT"} })
94462025-01-09T01:12:17.220ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
94472025-01-09T01:12:17.220ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94482025-01-09T01:12:17.319ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "36b36bc6-82ec-4e88-89eb-6324c194ef44", "date": "Thu, 09 Jan 2025 01:12:17 GMT"} })
94492025-01-09T01:12:17.319ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
94502025-01-09T01:12:17.319ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94512025-01-09T01:12:17.319ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "549ce7ae-4c7f-4ee4-8d7d-49dc0b62a2b6", "content-length": "682", "date": "Thu, 09 Jan 2025 01:12:17 GMT"} })
94522025-01-09T01:12:17.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94532025-01-09T01:12:17.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94542025-01-09T01:12:17.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94552025-01-09T01:12:17.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94562025-01-09T01:12:17.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94572025-01-09T01:12:17.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94582025-01-09T01:12:17.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94592025-01-09T01:12:17.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94602025-01-09T01:12:17.335ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 434.36878ms iteration = 18 status = {}
94612025-01-09T01:12:17.573ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94622025-01-09T01:12:17.573ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
94632025-01-09T01:12:17.604ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94642025-01-09T01:12:17.604ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:51354
94652025-01-09T01:12:17.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51354 req_id = 48b4b25a-b952-44c5-85e6-49819937b8ad roles = RoleSet { roles: {} } uri = /metrics/producers
94662025-01-09T01:12:17.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51354 req_id = 48b4b25a-b952-44c5-85e6-49819937b8ad resource = Database result = Ok(()) uri = /metrics/producers
94672025-01-09T01:12:17.640ZINFOnexus: assigned collector to new producer collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 file = nexus/src/app/oximeter.rs:76 producer_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
94682025-01-09T01:12:17.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35837 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51354 req_id = 48b4b25a-b952-44c5-85e6-49819937b8ad response_code = 201 uri = /metrics/producers
94692025-01-09T01:12:17.640ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "48b4b25a-b952-44c5-85e6-49819937b8ad", "content-length": "41", "date": "Thu, 09 Jan 2025 01:12:17 GMT"} })
94702025-01-09T01:12:17.641ZDEBGnexus (producer-registration-task): registered with nexus successfully
94712025-01-09T01:12:17.641ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94722025-01-09T01:12:18.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a9815d8c-7fff-47ff-9acf-088504595503 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94732025-01-09T01:12:18.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a9815d8c-7fff-47ff-9acf-088504595503 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94742025-01-09T01:12:18.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a9815d8c-7fff-47ff-9acf-088504595503 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94752025-01-09T01:12:19.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a167fad-6e72-42f1-8c67-b9d604d68f95 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94762025-01-09T01:12:19.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a167fad-6e72-42f1-8c67-b9d604d68f95 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94772025-01-09T01:12:19.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a167fad-6e72-42f1-8c67-b9d604d68f95 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94782025-01-09T01:12:19.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 648 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 87d1a95e-8b61-44ae-8b3e-f4e5d27fddde response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
94792025-01-09T01:12:20.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 34c65f9d-d647-41c5-874a-91fca8aa931c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94802025-01-09T01:12:20.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 34c65f9d-d647-41c5-874a-91fca8aa931c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94812025-01-09T01:12:20.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 34c65f9d-d647-41c5-874a-91fca8aa931c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94822025-01-09T01:12:21.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0eb535ab-b632-43c4-a33e-d0cdf870c498 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94832025-01-09T01:12:21.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0eb535ab-b632-43c4-a33e-d0cdf870c498 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94842025-01-09T01:12:21.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0eb535ab-b632-43c4-a33e-d0cdf870c498 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94852025-01-09T01:12:22.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 347e8859-720f-494a-ae26-48e2af3bdbe2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94862025-01-09T01:12:22.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 347e8859-720f-494a-ae26-48e2af3bdbe2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94872025-01-09T01:12:22.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 347e8859-720f-494a-ae26-48e2af3bdbe2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94882025-01-09T01:12:23.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a18f8d1a-7ac8-4eb5-ad44-18ed493a2215 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94892025-01-09T01:12:23.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a18f8d1a-7ac8-4eb5-ad44-18ed493a2215 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94902025-01-09T01:12:23.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a18f8d1a-7ac8-4eb5-ad44-18ed493a2215 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94912025-01-09T01:12:24.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c6b84f0-710f-4b2d-bccb-d5abe964bc8b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94922025-01-09T01:12:24.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c6b84f0-710f-4b2d-bccb-d5abe964bc8b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94932025-01-09T01:12:24.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c6b84f0-710f-4b2d-bccb-d5abe964bc8b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94942025-01-09T01:12:25.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c08b6e37-6677-40dc-bf22-7c5a7c708f96 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94952025-01-09T01:12:25.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c08b6e37-6677-40dc-bf22-7c5a7c708f96 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94962025-01-09T01:12:25.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c08b6e37-6677-40dc-bf22-7c5a7c708f96 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94972025-01-09T01:12:26.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8ef69e0-7c8b-479c-a625-b12eeeda6eb8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94982025-01-09T01:12:26.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8ef69e0-7c8b-479c-a625-b12eeeda6eb8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
94992025-01-09T01:12:26.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f8ef69e0-7c8b-479c-a625-b12eeeda6eb8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95002025-01-09T01:12:26.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
95012025-01-09T01:12:26.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95022025-01-09T01:12:26.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
95032025-01-09T01:12:26.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95042025-01-09T01:12:26.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95052025-01-09T01:12:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95062025-01-09T01:12:26.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95072025-01-09T01:12:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95082025-01-09T01:12:26.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95092025-01-09T01:12:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95102025-01-09T01:12:26.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95112025-01-09T01:12:26.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95122025-01-09T01:12:26.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95132025-01-09T01:12:26.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
95142025-01-09T01:12:26.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95152025-01-09T01:12:26.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95162025-01-09T01:12:26.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
95172025-01-09T01:12:26.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.999592ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
95182025-01-09T01:12:26.939ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95192025-01-09T01:12:26.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95202025-01-09T01:12:26.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.224267ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95212025-01-09T01:12:27.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37641419-19f2-4e6d-a80b-5633fb309479 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95222025-01-09T01:12:27.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37641419-19f2-4e6d-a80b-5633fb309479 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95232025-01-09T01:12:27.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37641419-19f2-4e6d-a80b-5633fb309479 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95242025-01-09T01:12:28.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21928da2-4721-4e30-a041-79a5a95cac57 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95252025-01-09T01:12:28.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21928da2-4721-4e30-a041-79a5a95cac57 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95262025-01-09T01:12:28.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21928da2-4721-4e30-a041-79a5a95cac57 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95272025-01-09T01:12:29.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0aa373bf-f1fe-4580-bc34-aeb8b7358a12 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95282025-01-09T01:12:29.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0aa373bf-f1fe-4580-bc34-aeb8b7358a12 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95292025-01-09T01:12:29.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0aa373bf-f1fe-4580-bc34-aeb8b7358a12 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95302025-01-09T01:12:29.934ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:62664
95312025-01-09T01:12:29.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = bf068fa0-ecf7-4572-a5d6-634595f2b638 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
95322025-01-09T01:12:29.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = bf068fa0-ecf7-4572-a5d6-634595f2b638 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
95332025-01-09T01:12:29.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = bf068fa0-ecf7-4572-a5d6-634595f2b638 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
95342025-01-09T01:12:29.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = f6e1ca4e-8a1e-4e4f-bfda-3840e84d6d15 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
95352025-01-09T01:12:29.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = f6e1ca4e-8a1e-4e4f-bfda-3840e84d6d15 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
95362025-01-09T01:12:29.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = f6e1ca4e-8a1e-4e4f-bfda-3840e84d6d15 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
95372025-01-09T01:12:29.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 1dfb3bf6-9442-4f3f-a324-2726155a76d7 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
95382025-01-09T01:12:30.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c799f451-2c0c-4e6b-bf3a-bd756baa0c2c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95392025-01-09T01:12:30.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c799f451-2c0c-4e6b-bf3a-bd756baa0c2c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95402025-01-09T01:12:30.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c799f451-2c0c-4e6b-bf3a-bd756baa0c2c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95412025-01-09T01:12:31.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dfb4da27-6360-48c7-a37d-c457f5ee4c51 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95422025-01-09T01:12:31.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dfb4da27-6360-48c7-a37d-c457f5ee4c51 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95432025-01-09T01:12:31.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dfb4da27-6360-48c7-a37d-c457f5ee4c51 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95442025-01-09T01:12:32.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eda32712-887c-49a5-bcaa-d329ea684f4a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95452025-01-09T01:12:32.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eda32712-887c-49a5-bcaa-d329ea684f4a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95462025-01-09T01:12:32.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eda32712-887c-49a5-bcaa-d329ea684f4a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95472025-01-09T01:12:33.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 25cfeac7-ce9e-463a-8dc9-bf0e733f2b1a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95482025-01-09T01:12:33.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 25cfeac7-ce9e-463a-8dc9-bf0e733f2b1a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95492025-01-09T01:12:33.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 25cfeac7-ce9e-463a-8dc9-bf0e733f2b1a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95502025-01-09T01:12:34.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 875cb092-3c3c-42b9-b40e-cd5431ba96c0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95512025-01-09T01:12:34.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 875cb092-3c3c-42b9-b40e-cd5431ba96c0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95522025-01-09T01:12:34.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 875cb092-3c3c-42b9-b40e-cd5431ba96c0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95532025-01-09T01:12:35.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 62bfb4eb-2132-48b4-8c15-ce08e367a8a1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95542025-01-09T01:12:35.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 62bfb4eb-2132-48b4-8c15-ce08e367a8a1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95552025-01-09T01:12:35.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 62bfb4eb-2132-48b4-8c15-ce08e367a8a1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95562025-01-09T01:12:36.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c5ab465-ef00-4e50-8438-647ae62ae33a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95572025-01-09T01:12:36.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c5ab465-ef00-4e50-8438-647ae62ae33a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95582025-01-09T01:12:36.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c5ab465-ef00-4e50-8438-647ae62ae33a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95592025-01-09T01:12:36.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
95602025-01-09T01:12:36.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95612025-01-09T01:12:36.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
95622025-01-09T01:12:36.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95632025-01-09T01:12:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95642025-01-09T01:12:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95652025-01-09T01:12:36.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95662025-01-09T01:12:36.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95672025-01-09T01:12:36.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95682025-01-09T01:12:36.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.875767ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95692025-01-09T01:12:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95702025-01-09T01:12:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95712025-01-09T01:12:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95722025-01-09T01:12:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95732025-01-09T01:12:36.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95742025-01-09T01:12:36.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95752025-01-09T01:12:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
95762025-01-09T01:12:36.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95772025-01-09T01:12:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95782025-01-09T01:12:36.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
95792025-01-09T01:12:36.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.247224ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
95802025-01-09T01:12:37.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d3a873c6-0fcc-4e1f-96c5-e61c60f76823 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95812025-01-09T01:12:37.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d3a873c6-0fcc-4e1f-96c5-e61c60f76823 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95822025-01-09T01:12:37.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d3a873c6-0fcc-4e1f-96c5-e61c60f76823 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95832025-01-09T01:12:38.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86991ec4-1294-4524-98f1-c6598eda696f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95842025-01-09T01:12:38.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86991ec4-1294-4524-98f1-c6598eda696f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95852025-01-09T01:12:38.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86991ec4-1294-4524-98f1-c6598eda696f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95862025-01-09T01:12:39.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ffa5c178-c610-476f-8477-dd07833ccb28 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95872025-01-09T01:12:39.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ffa5c178-c610-476f-8477-dd07833ccb28 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95882025-01-09T01:12:39.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ffa5c178-c610-476f-8477-dd07833ccb28 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95892025-01-09T01:12:39.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 524 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 9b01fa6f-2b87-4f60-857a-a09601ba1b65 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
95902025-01-09T01:12:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35569852-ccd6-4fae-a7c5-af4f4fea0b6e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95912025-01-09T01:12:40.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35569852-ccd6-4fae-a7c5-af4f4fea0b6e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95922025-01-09T01:12:40.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35569852-ccd6-4fae-a7c5-af4f4fea0b6e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95932025-01-09T01:12:41.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1ed2c613-61b0-4fde-b9a7-0cb1a146dca5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95942025-01-09T01:12:41.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1ed2c613-61b0-4fde-b9a7-0cb1a146dca5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95952025-01-09T01:12:41.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1ed2c613-61b0-4fde-b9a7-0cb1a146dca5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95962025-01-09T01:12:42.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 54dd803e-1489-41e4-b21b-34d124c06180 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95972025-01-09T01:12:42.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 54dd803e-1489-41e4-b21b-34d124c06180 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95982025-01-09T01:12:42.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 54dd803e-1489-41e4-b21b-34d124c06180 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
95992025-01-09T01:12:43.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9202e8b-21bf-441f-80b9-684203572e8a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96002025-01-09T01:12:43.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9202e8b-21bf-441f-80b9-684203572e8a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96012025-01-09T01:12:43.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d9202e8b-21bf-441f-80b9-684203572e8a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96022025-01-09T01:12:44.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d6e1704a-7c21-49e3-b543-72fc8539f430 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96032025-01-09T01:12:44.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d6e1704a-7c21-49e3-b543-72fc8539f430 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96042025-01-09T01:12:44.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d6e1704a-7c21-49e3-b543-72fc8539f430 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96052025-01-09T01:12:45.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 795deef8-4098-4ad8-b065-17c62aa3872b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96062025-01-09T01:12:45.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 795deef8-4098-4ad8-b065-17c62aa3872b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96072025-01-09T01:12:45.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 795deef8-4098-4ad8-b065-17c62aa3872b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96082025-01-09T01:12:46.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d08b8fbf-8e7a-4005-ad1a-a08e31a630c7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96092025-01-09T01:12:46.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d08b8fbf-8e7a-4005-ad1a-a08e31a630c7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96102025-01-09T01:12:46.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d08b8fbf-8e7a-4005-ad1a-a08e31a630c7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
96112025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
96122025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
96132025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96142025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96152025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96162025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
96172025-01-09T01:12:46.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:02:46.899750636 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96182025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
96192025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96202025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96212025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96222025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96232025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
96242025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
96252025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
96262025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96272025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96282025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
96292025-01-09T01:12:46.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
96302025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96312025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96322025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96332025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96342025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96352025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96362025-01-09T01:12:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 359772883 } })
96372025-01-09T01:12:46.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 359774573 } })
96382025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96392025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
96402025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
96412025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96422025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96432025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
96442025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
96452025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96462025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96472025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
96482025-01-09T01:12:46.900ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96492025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96502025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
96512025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96522025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
96532025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96542025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96552025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96562025-01-09T01:12:46.900ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96572025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
96582025-01-09T01:12:46.900ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
96592025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96602025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
96612025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.1\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
96622025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
96632025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96642025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96652025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
96662025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96672025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
96682025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
96692025-01-09T01:12:46.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96702025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96712025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96722025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
96732025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96742025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
96752025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96762025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
96772025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96782025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96792025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.256268ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96802025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96812025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96822025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96832025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96842025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96852025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96862025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96872025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
96882025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.282789ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
96892025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96902025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96912025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96922025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96932025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96942025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96952025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96962025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96972025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96982025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96992025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97002025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97012025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97022025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97032025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97042025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97052025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97062025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97072025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97082025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97092025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97102025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97112025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97122025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97132025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97142025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97152025-01-09T01:12:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97162025-01-09T01:12:46.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 362985175 } })
97172025-01-09T01:12:46.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97182025-01-09T01:12:46.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97192025-01-09T01:12:46.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 363373734 } })
97202025-01-09T01:12:46.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212025-01-09T01:12:46.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:02:46.899750636 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97222025-01-09T01:12:46.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97232025-01-09T01:12:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.470001ms iteration = 10 status = {"expiration":"2025-01-09T01:02:46.899750636Z","pruned":[]}
97242025-01-09T01:12:46.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97252025-01-09T01:12:46.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97262025-01-09T01:12:46.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97272025-01-09T01:12:46.906ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.993735ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97282025-01-09T01:12:46.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97292025-01-09T01:12:46.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97302025-01-09T01:12:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97312025-01-09T01:12:46.908ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97322025-01-09T01:12:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97332025-01-09T01:12:46.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97342025-01-09T01:12:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97352025-01-09T01:12:46.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97362025-01-09T01:12:46.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97372025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97382025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97392025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97402025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97412025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97422025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97432025-01-09T01:12:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97442025-01-09T01:12:46.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97452025-01-09T01:12:46.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97462025-01-09T01:12:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97472025-01-09T01:12:46.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97482025-01-09T01:12:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97492025-01-09T01:12:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97502025-01-09T01:12:46.916ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97512025-01-09T01:12:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97522025-01-09T01:12:46.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97532025-01-09T01:12:46.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97542025-01-09T01:12:46.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97552025-01-09T01:12:46.918ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97562025-01-09T01:12:46.919ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.463407ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97572025-01-09T01:12:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97582025-01-09T01:12:46.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97592025-01-09T01:12:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97602025-01-09T01:12:46.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97612025-01-09T01:12:46.923ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97622025-01-09T01:12:46.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97632025-01-09T01:12:46.924ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97642025-01-09T01:12:46.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97652025-01-09T01:12:46.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97662025-01-09T01:12:46.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97672025-01-09T01:12:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97682025-01-09T01:12:46.927ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97692025-01-09T01:12:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97702025-01-09T01:12:46.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97712025-01-09T01:12:46.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97722025-01-09T01:12:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97732025-01-09T01:12:46.932ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 391485688 } })
97742025-01-09T01:12:46.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97752025-01-09T01:12:46.932ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
97762025-01-09T01:12:46.934ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97772025-01-09T01:12:46.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97782025-01-09T01:12:46.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97792025-01-09T01:12:46.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97802025-01-09T01:12:46.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97812025-01-09T01:12:46.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97822025-01-09T01:12:46.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97832025-01-09T01:12:46.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97842025-01-09T01:12:46.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97852025-01-09T01:12:46.941ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97862025-01-09T01:12:46.941ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.070346ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97872025-01-09T01:12:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97882025-01-09T01:12:46.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97892025-01-09T01:12:46.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97902025-01-09T01:12:46.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97912025-01-09T01:12:46.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97922025-01-09T01:12:46.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
97932025-01-09T01:12:46.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97942025-01-09T01:12:46.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97952025-01-09T01:12:46.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97962025-01-09T01:12:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.276346ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
97972025-01-09T01:12:46.963ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97982025-01-09T01:12:46.963ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97992025-01-09T01:12:46.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98002025-01-09T01:12:46.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98012025-01-09T01:12:46.967ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98022025-01-09T01:12:46.967ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98032025-01-09T01:12:46.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98042025-01-09T01:12:46.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98052025-01-09T01:12:46.972ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98062025-01-09T01:12:46.972ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98072025-01-09T01:12:46.972ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98082025-01-09T01:12:46.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98092025-01-09T01:12:46.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98102025-01-09T01:12:46.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98112025-01-09T01:12:46.976ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
98122025-01-09T01:12:46.976ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
98132025-01-09T01:12:46.976ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.476673ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
98142025-01-09T01:12:46.978ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98152025-01-09T01:12:46.978ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98162025-01-09T01:12:46.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98172025-01-09T01:12:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98182025-01-09T01:12:46.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98192025-01-09T01:12:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98202025-01-09T01:12:46.980ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98212025-01-09T01:12:46.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.908643ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
98222025-01-09T01:12:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98232025-01-09T01:12:46.981ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98242025-01-09T01:12:46.981ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98252025-01-09T01:12:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98262025-01-09T01:12:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98272025-01-09T01:12:46.982ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98282025-01-09T01:12:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98292025-01-09T01:12:46.984ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
98302025-01-09T01:12:46.984ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.522634ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
98312025-01-09T01:12:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98322025-01-09T01:12:46.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98332025-01-09T01:12:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98342025-01-09T01:12:46.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.248413ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98352025-01-09T01:12:46.987ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98362025-01-09T01:12:46.987ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98372025-01-09T01:12:46.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98382025-01-09T01:12:46.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98392025-01-09T01:12:46.988ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98402025-01-09T01:12:46.989ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98412025-01-09T01:12:46.989ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98422025-01-09T01:12:46.989ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.324593ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98432025-01-09T01:12:46.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98442025-01-09T01:12:46.991ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98452025-01-09T01:12:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98462025-01-09T01:12:46.997ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98472025-01-09T01:12:46.997ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98482025-01-09T01:12:46.997ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98492025-01-09T01:12:46.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98502025-01-09T01:12:46.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98512025-01-09T01:12:47.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98522025-01-09T01:12:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98532025-01-09T01:12:47.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98542025-01-09T01:12:47.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98552025-01-09T01:12:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98562025-01-09T01:12:47.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98572025-01-09T01:12:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98582025-01-09T01:12:47.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98592025-01-09T01:12:47.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98602025-01-09T01:12:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98612025-01-09T01:12:47.013ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 112.987169ms iteration = 5 status = {"nsuccess":5}
98622025-01-09T01:12:47.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98632025-01-09T01:12:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98642025-01-09T01:12:47.015ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98652025-01-09T01:12:47.016ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98662025-01-09T01:12:47.016ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
98672025-01-09T01:12:47.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 116.327515ms iteration = 10 status = {"generation":1}
98682025-01-09T01:12:47.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98692025-01-09T01:12:47.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98702025-01-09T01:12:47.026ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98712025-01-09T01:12:47.026ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
98722025-01-09T01:12:47.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98732025-01-09T01:12:47.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98742025-01-09T01:12:47.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98752025-01-09T01:12:47.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98762025-01-09T01:12:47.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98772025-01-09T01:12:47.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98782025-01-09T01:12:47.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98792025-01-09T01:12:47.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98802025-01-09T01:12:47.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98812025-01-09T01:12:47.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98822025-01-09T01:12:47.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98832025-01-09T01:12:47.036ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98842025-01-09T01:12:47.036ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 135.573039ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98852025-01-09T01:12:47.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98862025-01-09T01:12:47.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98872025-01-09T01:12:47.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98882025-01-09T01:12:47.038ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98892025-01-09T01:12:47.038ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98902025-01-09T01:12:47.038ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.571884ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98912025-01-09T01:12:47.040ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
98922025-01-09T01:12:47.040ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98932025-01-09T01:12:47.040ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
98942025-01-09T01:12:47.040ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 140.567491ms iteration = 10 status = {"generation":2}
98952025-01-09T01:12:47.042ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98962025-01-09T01:12:47.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98972025-01-09T01:12:47.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98982025-01-09T01:12:47.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.331926ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98992025-01-09T01:12:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 153.256898ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99002025-01-09T01:12:47.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99012025-01-09T01:12:47.058ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99022025-01-09T01:12:47.058ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99032025-01-09T01:12:47.058ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d07070e0-8996-4690-9c86-013efa82f7d3", "content-length": "26", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99042025-01-09T01:12:47.058ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99052025-01-09T01:12:47.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99062025-01-09T01:12:47.060ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99072025-01-09T01:12:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99082025-01-09T01:12:47.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99092025-01-09T01:12:47.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99102025-01-09T01:12:47.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99112025-01-09T01:12:47.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
99122025-01-09T01:12:47.068ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99132025-01-09T01:12:47.068ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd66c487-d5ef-41ef-a438-c60fc4ed04a8", "content-length": "26", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99142025-01-09T01:12:47.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99152025-01-09T01:12:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
99162025-01-09T01:12:47.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99172025-01-09T01:12:47.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99182025-01-09T01:12:47.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99192025-01-09T01:12:47.070ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
99202025-01-09T01:12:47.070ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99212025-01-09T01:12:47.070ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "686e97dc-e7f1-4b3c-9bc2-b3678a6df76a", "content-length": "26", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99222025-01-09T01:12:47.071ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99232025-01-09T01:12:47.071ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.272682ms iteration = 19 status = 0
99242025-01-09T01:12:47.073ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
99252025-01-09T01:12:47.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99262025-01-09T01:12:47.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99272025-01-09T01:12:47.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99282025-01-09T01:12:47.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99292025-01-09T01:12:47.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99302025-01-09T01:12:47.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99312025-01-09T01:12:47.089ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.968783ms iteration = 21 status = {"physical_disks_added":0}
99322025-01-09T01:12:47.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99332025-01-09T01:12:47.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 192.278058ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
99342025-01-09T01:12:47.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99352025-01-09T01:12:47.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99362025-01-09T01:12:47.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99372025-01-09T01:12:47.101ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
99382025-01-09T01:12:47.102ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 202.229642ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
99392025-01-09T01:12:47.202ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99402025-01-09T01:12:47.232ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99412025-01-09T01:12:47.233ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "be3e2cc2-e04a-410b-968a-b7a6eb4f0cea", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99422025-01-09T01:12:47.233ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99432025-01-09T01:12:47.235ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99442025-01-09T01:12:47.235ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "80dbc07c-f2e5-42af-8f6c-969ee37896e4", "content-length": "1", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99452025-01-09T01:12:47.237ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4359f4d1-f127-4a59-a6c5-d8c4622ce4c7", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99462025-01-09T01:12:47.237ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99472025-01-09T01:12:47.244ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99482025-01-09T01:12:47.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 344.623765ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99492025-01-09T01:12:47.245ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.26921ms iteration = 19 status = {}
99502025-01-09T01:12:47.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99512025-01-09T01:12:47.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99522025-01-09T01:12:47.247ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.795907ms iteration = 19 status = null
99532025-01-09T01:12:47.249ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99542025-01-09T01:12:47.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99552025-01-09T01:12:47.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "703b66bb-2b61-42ca-a5d5-19cd9d9f8605", "content-length": "372", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99562025-01-09T01:12:47.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99572025-01-09T01:12:47.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99582025-01-09T01:12:47.264ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99592025-01-09T01:12:47.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99602025-01-09T01:12:47.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a10fc6c2-eac5-49ea-97fb-4d6d91b862d2", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99612025-01-09T01:12:47.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99622025-01-09T01:12:47.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99632025-01-09T01:12:47.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99642025-01-09T01:12:47.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99652025-01-09T01:12:47.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99662025-01-09T01:12:47.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99672025-01-09T01:12:47.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99682025-01-09T01:12:47.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a2bd2e4-9b14-4715-8b2c-e6240fe44885", "content-length": "691", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99692025-01-09T01:12:47.291ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99702025-01-09T01:12:47.291ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99712025-01-09T01:12:47.291ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99722025-01-09T01:12:47.292ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 391.996814ms iteration = 19 status = {}
99732025-01-09T01:12:47.294ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99742025-01-09T01:12:47.294ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99752025-01-09T01:12:47.294ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e7f34e3c-8166-4bee-baad-0d983f2defb8", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
99762025-01-09T01:12:47.296ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.531414ms iteration = 19 status = {}
99772025-01-09T01:12:47.305ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99782025-01-09T01:12:47.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8355aa46-45ab-4b0f-b122-9f7e3f5b036e", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99792025-01-09T01:12:47.306ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99802025-01-09T01:12:47.307ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "46eaf194-6d95-4345-b151-8034d90875f2", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99812025-01-09T01:12:47.307ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99822025-01-09T01:12:47.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "450768d0-6877-4195-9300-7f84fa7723b4", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99832025-01-09T01:12:47.308ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99842025-01-09T01:12:47.310ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
99852025-01-09T01:12:47.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 410.754618ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99862025-01-09T01:12:47.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99872025-01-09T01:12:47.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99882025-01-09T01:12:47.346ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
99892025-01-09T01:12:47.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99902025-01-09T01:12:47.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99912025-01-09T01:12:47.354ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99922025-01-09T01:12:47.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "476e5f53-0930-4af6-b5a2-8fc51448324b", "content-length": "134", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} })
99932025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99942025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
99952025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99962025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99972025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99982025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99992025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100002025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100012025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100022025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100032025-01-09T01:12:47.355ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
100042025-01-09T01:12:47.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100052025-01-09T01:12:47.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100062025-01-09T01:12:47.357ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100072025-01-09T01:12:47.358ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b36a94b-bc26-4f06-8790-f15ee6392dd3", "content-length": "2", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} })
100082025-01-09T01:12:47.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100092025-01-09T01:12:47.358ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf7feb6b-c6a1-46dd-9c57-18cb5dacfb26", "content-length": "52", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} })
100102025-01-09T01:12:47.358ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
100112025-01-09T01:12:47.358ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100122025-01-09T01:12:47.581ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1f64b0ad-bb38-4b2d-8a98-9da91e9937b3", "date": "Thu, 09 Jan 2025 01:12:46 GMT"} })
100132025-01-09T01:12:47.581ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
100142025-01-09T01:12:47.581ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100152025-01-09T01:12:47.581ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "929f7d03-8dde-4009-8ddd-4c4973ef6b76", "content-length": "682", "date": "Thu, 09 Jan 2025 01:12:47 GMT"} })
100162025-01-09T01:12:47.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100172025-01-09T01:12:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100182025-01-09T01:12:47.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100192025-01-09T01:12:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100202025-01-09T01:12:47.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100212025-01-09T01:12:47.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100222025-01-09T01:12:47.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100232025-01-09T01:12:47.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100242025-01-09T01:12:47.596ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.477561ms iteration = 19 status = {}
100252025-01-09T01:12:47.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 00bdcd9f-673a-4299-87e2-78ee927120af roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100262025-01-09T01:12:47.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 00bdcd9f-673a-4299-87e2-78ee927120af resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100272025-01-09T01:12:47.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 00bdcd9f-673a-4299-87e2-78ee927120af response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100282025-01-09T01:12:48.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 223821be-298c-4e16-8dc1-768ed730a358 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100292025-01-09T01:12:48.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 223821be-298c-4e16-8dc1-768ed730a358 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100302025-01-09T01:12:48.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 223821be-298c-4e16-8dc1-768ed730a358 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100312025-01-09T01:12:49.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 68ff6acc-73e9-4572-a055-251cbbe88316 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100322025-01-09T01:12:49.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 68ff6acc-73e9-4572-a055-251cbbe88316 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100332025-01-09T01:12:49.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 68ff6acc-73e9-4572-a055-251cbbe88316 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100342025-01-09T01:12:49.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 92b83987-0d63-4606-b67b-afc802d9c050 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
100352025-01-09T01:12:50.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2871c32b-4393-45e7-ac9c-86960a6f67e3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100362025-01-09T01:12:50.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2871c32b-4393-45e7-ac9c-86960a6f67e3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100372025-01-09T01:12:50.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2871c32b-4393-45e7-ac9c-86960a6f67e3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100382025-01-09T01:12:51.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b05b5383-e3e1-4d81-bd5c-0382abe85093 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100392025-01-09T01:12:51.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b05b5383-e3e1-4d81-bd5c-0382abe85093 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100402025-01-09T01:12:51.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b05b5383-e3e1-4d81-bd5c-0382abe85093 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100412025-01-09T01:12:52.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 673709cb-d144-456d-9de7-40615c454584 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100422025-01-09T01:12:52.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 673709cb-d144-456d-9de7-40615c454584 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100432025-01-09T01:12:52.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 673709cb-d144-456d-9de7-40615c454584 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100442025-01-09T01:12:53.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ee68a6a-0cd9-435a-bb36-ea8a9544e9c4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100452025-01-09T01:12:53.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ee68a6a-0cd9-435a-bb36-ea8a9544e9c4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100462025-01-09T01:12:53.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ee68a6a-0cd9-435a-bb36-ea8a9544e9c4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100472025-01-09T01:12:54.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 94649089-5d0d-4635-9e54-081c80f1bc4e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100482025-01-09T01:12:54.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 94649089-5d0d-4635-9e54-081c80f1bc4e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100492025-01-09T01:12:54.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 94649089-5d0d-4635-9e54-081c80f1bc4e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100502025-01-09T01:12:55.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 020b44ae-9d01-4296-be0c-78f8566ec724 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100512025-01-09T01:12:55.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 020b44ae-9d01-4296-be0c-78f8566ec724 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100522025-01-09T01:12:55.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 020b44ae-9d01-4296-be0c-78f8566ec724 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100532025-01-09T01:12:56.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
100542025-01-09T01:12:56.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100552025-01-09T01:12:56.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
100562025-01-09T01:12:56.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100572025-01-09T01:12:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100582025-01-09T01:12:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100592025-01-09T01:12:56.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100602025-01-09T01:12:56.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100612025-01-09T01:12:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100622025-01-09T01:12:56.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.124673ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100632025-01-09T01:12:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100642025-01-09T01:12:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100652025-01-09T01:12:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100662025-01-09T01:12:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100672025-01-09T01:12:56.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100682025-01-09T01:12:56.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100692025-01-09T01:12:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
100702025-01-09T01:12:56.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100712025-01-09T01:12:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100722025-01-09T01:12:56.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
100732025-01-09T01:12:56.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.987203ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
100742025-01-09T01:12:57.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7573092d-fd1c-4d9f-82ce-6f17d2cee22a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100752025-01-09T01:12:57.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7573092d-fd1c-4d9f-82ce-6f17d2cee22a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100762025-01-09T01:12:57.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7573092d-fd1c-4d9f-82ce-6f17d2cee22a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100772025-01-09T01:12:58.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8befc30f-cfc1-48a7-892b-e10c7aef7ae4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100782025-01-09T01:12:58.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8befc30f-cfc1-48a7-892b-e10c7aef7ae4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100792025-01-09T01:12:58.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8befc30f-cfc1-48a7-892b-e10c7aef7ae4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100802025-01-09T01:12:59.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 87e46935-fdcd-424e-a195-e43641835626 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100812025-01-09T01:12:59.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 87e46935-fdcd-424e-a195-e43641835626 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100822025-01-09T01:12:59.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 87e46935-fdcd-424e-a195-e43641835626 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100832025-01-09T01:12:59.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = c21dbb02-8028-43b3-8f31-3a31c9e41a00 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
100842025-01-09T01:13:00.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b7ed7e2d-8efb-4cf5-894b-8a8b6a4a04dc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100852025-01-09T01:13:00.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b7ed7e2d-8efb-4cf5-894b-8a8b6a4a04dc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100862025-01-09T01:13:00.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b7ed7e2d-8efb-4cf5-894b-8a8b6a4a04dc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100872025-01-09T01:13:01.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c391dae5-bdad-484d-b2bb-116476b6f18b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100882025-01-09T01:13:01.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c391dae5-bdad-484d-b2bb-116476b6f18b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100892025-01-09T01:13:01.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c391dae5-bdad-484d-b2bb-116476b6f18b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100902025-01-09T01:13:02.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27b59ee4-1f77-4e88-8d19-4479a70e5b43 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100912025-01-09T01:13:02.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27b59ee4-1f77-4e88-8d19-4479a70e5b43 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100922025-01-09T01:13:02.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27b59ee4-1f77-4e88-8d19-4479a70e5b43 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100932025-01-09T01:13:03.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82dff200-40c5-4d06-919e-82f89310355f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100942025-01-09T01:13:03.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82dff200-40c5-4d06-919e-82f89310355f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100952025-01-09T01:13:03.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82dff200-40c5-4d06-919e-82f89310355f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100962025-01-09T01:13:04.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 631e75c7-24e7-4711-a82b-0d2680ae2d50 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100972025-01-09T01:13:04.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 631e75c7-24e7-4711-a82b-0d2680ae2d50 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100982025-01-09T01:13:04.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 631e75c7-24e7-4711-a82b-0d2680ae2d50 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
100992025-01-09T01:13:05.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8bdb4215-626e-42ee-b1a5-c1f71f244319 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101002025-01-09T01:13:05.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8bdb4215-626e-42ee-b1a5-c1f71f244319 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101012025-01-09T01:13:05.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8bdb4215-626e-42ee-b1a5-c1f71f244319 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101022025-01-09T01:13:06.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0905349e-6b70-4ea4-b7c3-0b2bc426fb5f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101032025-01-09T01:13:06.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0905349e-6b70-4ea4-b7c3-0b2bc426fb5f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101042025-01-09T01:13:06.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0905349e-6b70-4ea4-b7c3-0b2bc426fb5f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101052025-01-09T01:13:06.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
101062025-01-09T01:13:06.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
101072025-01-09T01:13:06.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101082025-01-09T01:13:06.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101092025-01-09T01:13:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101102025-01-09T01:13:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101112025-01-09T01:13:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101122025-01-09T01:13:06.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101132025-01-09T01:13:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101142025-01-09T01:13:06.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.621671ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101152025-01-09T01:13:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101162025-01-09T01:13:06.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101172025-01-09T01:13:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101182025-01-09T01:13:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101192025-01-09T01:13:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101202025-01-09T01:13:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101212025-01-09T01:13:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
101222025-01-09T01:13:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101232025-01-09T01:13:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101242025-01-09T01:13:06.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
101252025-01-09T01:13:06.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.705987ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
101262025-01-09T01:13:07.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9762d4b-9ed5-4d92-8813-d3559e5f5ce5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101272025-01-09T01:13:07.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9762d4b-9ed5-4d92-8813-d3559e5f5ce5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101282025-01-09T01:13:07.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9762d4b-9ed5-4d92-8813-d3559e5f5ce5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101292025-01-09T01:13:08.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c23d0338-06a8-4be7-aa42-e26fc6d5b67f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101302025-01-09T01:13:08.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c23d0338-06a8-4be7-aa42-e26fc6d5b67f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101312025-01-09T01:13:08.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c23d0338-06a8-4be7-aa42-e26fc6d5b67f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101322025-01-09T01:13:09.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2dbf25d4-9d78-4dc7-8a47-0902bc9ade0e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101332025-01-09T01:13:09.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2dbf25d4-9d78-4dc7-8a47-0902bc9ade0e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101342025-01-09T01:13:09.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2dbf25d4-9d78-4dc7-8a47-0902bc9ade0e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101352025-01-09T01:13:09.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 670 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 43c06cbb-1d9c-402f-bbdd-e71b60f99fee response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
101362025-01-09T01:13:10.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4b2512a4-79f1-4154-bc67-b0d5000b9316 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101372025-01-09T01:13:10.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4b2512a4-79f1-4154-bc67-b0d5000b9316 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101382025-01-09T01:13:10.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4b2512a4-79f1-4154-bc67-b0d5000b9316 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101392025-01-09T01:13:11.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 68ba8b10-ba43-435d-a03a-7c7d45a61483 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101402025-01-09T01:13:11.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 68ba8b10-ba43-435d-a03a-7c7d45a61483 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101412025-01-09T01:13:11.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 68ba8b10-ba43-435d-a03a-7c7d45a61483 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101422025-01-09T01:13:12.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee3d65e0-4b7b-4fa5-88ef-f0bbc3d1fce7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101432025-01-09T01:13:12.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee3d65e0-4b7b-4fa5-88ef-f0bbc3d1fce7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101442025-01-09T01:13:12.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee3d65e0-4b7b-4fa5-88ef-f0bbc3d1fce7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101452025-01-09T01:13:13.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 361ecbed-3201-4ae6-bc16-c23f8b121499 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101462025-01-09T01:13:13.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 361ecbed-3201-4ae6-bc16-c23f8b121499 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101472025-01-09T01:13:13.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 361ecbed-3201-4ae6-bc16-c23f8b121499 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101482025-01-09T01:13:14.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8263780f-7606-46ee-bb0d-8be9b780cce6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101492025-01-09T01:13:14.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8263780f-7606-46ee-bb0d-8be9b780cce6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101502025-01-09T01:13:14.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8263780f-7606-46ee-bb0d-8be9b780cce6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101512025-01-09T01:13:15.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 586ee1e9-1e16-4936-9a61-65c2fdaf95b2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101522025-01-09T01:13:15.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 586ee1e9-1e16-4936-9a61-65c2fdaf95b2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101532025-01-09T01:13:15.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 586ee1e9-1e16-4936-9a61-65c2fdaf95b2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101542025-01-09T01:13:16.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c047577d-21ea-432d-bda5-8131bd60fc6e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101552025-01-09T01:13:16.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c047577d-21ea-432d-bda5-8131bd60fc6e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101562025-01-09T01:13:16.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c047577d-21ea-432d-bda5-8131bd60fc6e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
101572025-01-09T01:13:16.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
101582025-01-09T01:13:16.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
101592025-01-09T01:13:16.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101602025-01-09T01:13:16.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101612025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101622025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101632025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
101642025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
101652025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101662025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
101672025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101682025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101692025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
101702025-01-09T01:13:16.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101712025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
101722025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101732025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
101742025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101752025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
101762025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101772025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101782025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
101792025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101802025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101812025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
101822025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101832025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
101842025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101852025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
101862025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101872025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
101882025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101892025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
101902025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
101912025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101922025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
101932025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101942025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101952025-01-09T01:13:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101962025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101972025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101982025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101992025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102002025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102012025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102022025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102032025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102042025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102052025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102062025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102072025-01-09T01:13:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102082025-01-09T01:13:16.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1640, tv_nsec: 362596379 } })
102092025-01-09T01:13:16.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
102102025-01-09T01:13:16.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102112025-01-09T01:13:16.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1640, tv_nsec: 363839047 } })
102122025-01-09T01:13:16.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102132025-01-09T01:13:16.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
102142025-01-09T01:13:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.813006ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
102152025-01-09T01:13:16.906ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.279457ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102162025-01-09T01:13:16.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102172025-01-09T01:13:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102182025-01-09T01:13:16.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102192025-01-09T01:13:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102202025-01-09T01:13:16.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102212025-01-09T01:13:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102222025-01-09T01:13:16.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102232025-01-09T01:13:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102242025-01-09T01:13:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102252025-01-09T01:13:16.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102262025-01-09T01:13:16.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102272025-01-09T01:13:16.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102282025-01-09T01:13:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102292025-01-09T01:13:16.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102302025-01-09T01:13:16.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102312025-01-09T01:13:16.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102322025-01-09T01:13:16.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102332025-01-09T01:13:16.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102342025-01-09T01:13:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102352025-01-09T01:13:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102362025-01-09T01:13:16.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102372025-01-09T01:13:16.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102382025-01-09T01:13:16.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.350556ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
102392025-01-09T01:13:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102402025-01-09T01:13:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102412025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102422025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102432025-01-09T01:13:16.915ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1640, tv_nsec: 374304203 } })
102442025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102452025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102462025-01-09T01:13:16.915ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
102472025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102482025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102492025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102502025-01-09T01:13:16.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102512025-01-09T01:13:16.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102522025-01-09T01:13:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102532025-01-09T01:13:16.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.743985ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102542025-01-09T01:13:16.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102552025-01-09T01:13:16.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102562025-01-09T01:13:16.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.897194ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102572025-01-09T01:13:16.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102582025-01-09T01:13:16.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102592025-01-09T01:13:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102602025-01-09T01:13:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102612025-01-09T01:13:16.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102622025-01-09T01:13:16.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102632025-01-09T01:13:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102642025-01-09T01:13:16.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102652025-01-09T01:13:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102662025-01-09T01:13:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
102672025-01-09T01:13:16.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102682025-01-09T01:13:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102692025-01-09T01:13:16.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102702025-01-09T01:13:16.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102712025-01-09T01:13:16.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102722025-01-09T01:13:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102732025-01-09T01:13:16.952ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102742025-01-09T01:13:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102752025-01-09T01:13:16.958ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102762025-01-09T01:13:16.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.146929ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102772025-01-09T01:13:16.959ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102782025-01-09T01:13:16.959ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102792025-01-09T01:13:16.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102802025-01-09T01:13:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102812025-01-09T01:13:16.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102822025-01-09T01:13:16.987ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102832025-01-09T01:13:16.988ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83650e15-5c4c-4c62-91f9-0aa7dbbfb42f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
102842025-01-09T01:13:16.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102852025-01-09T01:13:16.990ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102862025-01-09T01:13:16.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102872025-01-09T01:13:16.995ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102882025-01-09T01:13:16.995ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e4fb15d-89eb-4627-bc5b-7c5285ef7681", "content-length": "26", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
102892025-01-09T01:13:16.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102902025-01-09T01:13:16.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102912025-01-09T01:13:17.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
102922025-01-09T01:13:17.001ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102932025-01-09T01:13:17.001ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72b6953f-82c7-4b76-929b-5130b3ee6a59", "content-length": "26", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
102942025-01-09T01:13:17.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102952025-01-09T01:13:17.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
102962025-01-09T01:13:17.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102972025-01-09T01:13:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102982025-01-09T01:13:17.017ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102992025-01-09T01:13:17.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103002025-01-09T01:13:17.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103012025-01-09T01:13:17.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103022025-01-09T01:13:17.042ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
103032025-01-09T01:13:17.042ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 141.194756ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
103042025-01-09T01:13:17.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103052025-01-09T01:13:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103062025-01-09T01:13:17.060ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103072025-01-09T01:13:17.060ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103082025-01-09T01:13:17.060ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.778142ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103092025-01-09T01:13:17.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103102025-01-09T01:13:17.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "115b3841-1766-4f20-8ec0-62baba45dcc2", "content-length": "372", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
103112025-01-09T01:13:17.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103122025-01-09T01:13:17.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
103132025-01-09T01:13:17.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103142025-01-09T01:13:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103152025-01-09T01:13:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103162025-01-09T01:13:17.073ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 171.448988ms iteration = 20 status = 0
103172025-01-09T01:13:17.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 174.378714ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103182025-01-09T01:13:17.079ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 178.517248ms iteration = 20 status = {}
103192025-01-09T01:13:17.090ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103202025-01-09T01:13:17.090ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec8e7961-5d1a-45ee-82f4-2b2002e3231c", "content-length": "1", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
103212025-01-09T01:13:17.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 188.878691ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
103222025-01-09T01:13:17.091ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103232025-01-09T01:13:17.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103242025-01-09T01:13:17.093ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.267461ms iteration = 20 status = null
103252025-01-09T01:13:17.118ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103262025-01-09T01:13:17.118ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103272025-01-09T01:13:17.119ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bd57f15c-5eb5-42b6-9dc3-fa1da1575bda", "date": "Thu, 09 Jan 2025 01:13:17 GMT"} })
103282025-01-09T01:13:17.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103292025-01-09T01:13:17.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103302025-01-09T01:13:17.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103312025-01-09T01:13:17.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103322025-01-09T01:13:17.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103332025-01-09T01:13:17.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103342025-01-09T01:13:17.128ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103352025-01-09T01:13:17.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103362025-01-09T01:13:17.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "017acc11-827d-4e4a-a86d-246f1e9ed623", "date": "Thu, 09 Jan 2025 01:13:17 GMT"} })
103372025-01-09T01:13:17.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103382025-01-09T01:13:17.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103392025-01-09T01:13:17.130ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.757931ms iteration = 22 status = {"physical_disks_added":0}
103402025-01-09T01:13:17.131ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 229.365275ms iteration = 20 status = {}
103412025-01-09T01:13:17.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103422025-01-09T01:13:17.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103432025-01-09T01:13:17.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103442025-01-09T01:13:17.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103452025-01-09T01:13:17.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103462025-01-09T01:13:17.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103472025-01-09T01:13:17.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103482025-01-09T01:13:17.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103492025-01-09T01:13:17.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103502025-01-09T01:13:17.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103512025-01-09T01:13:17.156ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
103522025-01-09T01:13:17.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103532025-01-09T01:13:17.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103542025-01-09T01:13:17.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103552025-01-09T01:13:17.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bd744e0-d3fd-4695-aaee-29eb6ef2589f", "content-length": "134", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
103562025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103572025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
103582025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103592025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103602025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103612025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103622025-01-09T01:13:17.167ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103632025-01-09T01:13:17.168ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103642025-01-09T01:13:17.168ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103652025-01-09T01:13:17.168ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103662025-01-09T01:13:17.168ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
103672025-01-09T01:13:17.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103682025-01-09T01:13:17.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103692025-01-09T01:13:17.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103702025-01-09T01:13:17.170ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a195a619-ef7a-4377-94b6-a533a14dcc24", "content-length": "2", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
103712025-01-09T01:13:17.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103722025-01-09T01:13:17.170ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b154bc0-117a-460e-8d09-330d20852659", "content-length": "52", "date": "Thu, 09 Jan 2025 01:13:16 GMT"} })
103732025-01-09T01:13:17.170ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
103742025-01-09T01:13:17.170ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103752025-01-09T01:13:17.229ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103762025-01-09T01:13:17.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "295827d2-4d47-419a-9141-c2a8c1c5a1e5", "content-length": "691", "date": "Thu, 09 Jan 2025 01:13:17 GMT"} })
103772025-01-09T01:13:17.231ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103782025-01-09T01:13:17.231ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103792025-01-09T01:13:17.231ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103802025-01-09T01:13:17.232ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 330.535748ms iteration = 20 status = {}
103812025-01-09T01:13:17.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d32e0502-b6b4-4781-85d8-37e1edc9c4ca", "date": "Thu, 09 Jan 2025 01:13:17 GMT"} })
103822025-01-09T01:13:17.274ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
103832025-01-09T01:13:17.274ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103842025-01-09T01:13:17.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "518fce47-0600-44cc-aac8-dac92a677398", "content-length": "682", "date": "Thu, 09 Jan 2025 01:13:17 GMT"} })
103852025-01-09T01:13:17.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103862025-01-09T01:13:17.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103872025-01-09T01:13:17.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103882025-01-09T01:13:17.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103892025-01-09T01:13:17.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103902025-01-09T01:13:17.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103912025-01-09T01:13:17.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103922025-01-09T01:13:17.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103932025-01-09T01:13:17.291ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 390.282175ms iteration = 20 status = {}
103942025-01-09T01:13:17.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7904b81-bf6a-4775-8c07-5c665632c71f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
103952025-01-09T01:13:17.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7904b81-bf6a-4775-8c07-5c665632c71f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
103962025-01-09T01:13:17.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c7904b81-bf6a-4775-8c07-5c665632c71f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
103972025-01-09T01:13:18.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b27b59d-ff65-432b-a02a-310cce426371 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
103982025-01-09T01:13:18.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b27b59d-ff65-432b-a02a-310cce426371 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
103992025-01-09T01:13:18.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b27b59d-ff65-432b-a02a-310cce426371 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104002025-01-09T01:13:19.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e196e8a0-09d5-4ccf-a5fd-b2764811bc12 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104012025-01-09T01:13:19.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e196e8a0-09d5-4ccf-a5fd-b2764811bc12 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104022025-01-09T01:13:19.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e196e8a0-09d5-4ccf-a5fd-b2764811bc12 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104032025-01-09T01:13:19.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 4e8722d0-fb9c-4a76-b94a-a2c3f242677d response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
104042025-01-09T01:13:20.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b274b45-1536-46fc-aed1-cb92a93c654f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104052025-01-09T01:13:20.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b274b45-1536-46fc-aed1-cb92a93c654f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104062025-01-09T01:13:20.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b274b45-1536-46fc-aed1-cb92a93c654f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104072025-01-09T01:13:21.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a4cc07f-931e-43c5-bfd6-39cfd994a9b5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104082025-01-09T01:13:21.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a4cc07f-931e-43c5-bfd6-39cfd994a9b5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104092025-01-09T01:13:21.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a4cc07f-931e-43c5-bfd6-39cfd994a9b5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104102025-01-09T01:13:22.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5993ad0-5b5a-46b3-8d39-b2930f03a8ba roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104112025-01-09T01:13:22.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5993ad0-5b5a-46b3-8d39-b2930f03a8ba resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104122025-01-09T01:13:22.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f5993ad0-5b5a-46b3-8d39-b2930f03a8ba response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104132025-01-09T01:13:23.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3afee5fa-df9f-41ed-abaf-0237c2cd4f39 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104142025-01-09T01:13:23.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3afee5fa-df9f-41ed-abaf-0237c2cd4f39 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104152025-01-09T01:13:23.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3afee5fa-df9f-41ed-abaf-0237c2cd4f39 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104162025-01-09T01:13:24.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eb031481-e99c-4bbf-a78c-817f4360da2b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104172025-01-09T01:13:24.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eb031481-e99c-4bbf-a78c-817f4360da2b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104182025-01-09T01:13:24.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = eb031481-e99c-4bbf-a78c-817f4360da2b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104192025-01-09T01:13:25.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 64f5b09a-53e3-49a9-be99-c83ac7e6eae3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104202025-01-09T01:13:25.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 64f5b09a-53e3-49a9-be99-c83ac7e6eae3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104212025-01-09T01:13:25.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 64f5b09a-53e3-49a9-be99-c83ac7e6eae3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104222025-01-09T01:13:26.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 972bb293-d3cd-4c04-90c8-da732f5d7c02 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104232025-01-09T01:13:26.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 972bb293-d3cd-4c04-90c8-da732f5d7c02 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104242025-01-09T01:13:26.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 972bb293-d3cd-4c04-90c8-da732f5d7c02 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104252025-01-09T01:13:26.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
104262025-01-09T01:13:26.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
104272025-01-09T01:13:26.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104282025-01-09T01:13:26.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104292025-01-09T01:13:26.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104302025-01-09T01:13:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104312025-01-09T01:13:26.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104322025-01-09T01:13:26.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104332025-01-09T01:13:26.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104342025-01-09T01:13:26.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.187734ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104352025-01-09T01:13:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104362025-01-09T01:13:26.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104372025-01-09T01:13:26.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104382025-01-09T01:13:26.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104392025-01-09T01:13:26.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104402025-01-09T01:13:26.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104412025-01-09T01:13:26.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
104422025-01-09T01:13:26.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104432025-01-09T01:13:26.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104442025-01-09T01:13:26.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
104452025-01-09T01:13:26.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.173643ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
104462025-01-09T01:13:27.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6bb1e9b6-d354-4d9d-8ee4-a0e028f0de28 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104472025-01-09T01:13:27.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6bb1e9b6-d354-4d9d-8ee4-a0e028f0de28 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104482025-01-09T01:13:27.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6bb1e9b6-d354-4d9d-8ee4-a0e028f0de28 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104492025-01-09T01:13:28.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bdb5e637-814f-4590-b19e-ef9cfd389258 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104502025-01-09T01:13:28.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bdb5e637-814f-4590-b19e-ef9cfd389258 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104512025-01-09T01:13:28.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bdb5e637-814f-4590-b19e-ef9cfd389258 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104522025-01-09T01:13:29.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5bcbee71-556f-47a0-85fe-6a5c9ee65e6e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104532025-01-09T01:13:29.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5bcbee71-556f-47a0-85fe-6a5c9ee65e6e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104542025-01-09T01:13:29.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5bcbee71-556f-47a0-85fe-6a5c9ee65e6e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104552025-01-09T01:13:29.942ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = b418e636-d296-4e42-b0d4-5b5fec074d3b response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
104562025-01-09T01:13:30.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c9dc8e3f-9b36-46be-acbd-2bc92a55b000 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104572025-01-09T01:13:30.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c9dc8e3f-9b36-46be-acbd-2bc92a55b000 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104582025-01-09T01:13:30.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c9dc8e3f-9b36-46be-acbd-2bc92a55b000 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104592025-01-09T01:13:31.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a99139a-4ff6-4a9f-b0e4-7479b050cba0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104602025-01-09T01:13:31.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a99139a-4ff6-4a9f-b0e4-7479b050cba0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104612025-01-09T01:13:31.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4a99139a-4ff6-4a9f-b0e4-7479b050cba0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104622025-01-09T01:13:32.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3b0efa0f-beaf-4733-aa1b-6c7bb8f4f2c8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104632025-01-09T01:13:32.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3b0efa0f-beaf-4733-aa1b-6c7bb8f4f2c8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104642025-01-09T01:13:32.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3b0efa0f-beaf-4733-aa1b-6c7bb8f4f2c8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104652025-01-09T01:13:33.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c0ec13e2-432f-46fe-ac1e-cafb806a74a0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104662025-01-09T01:13:33.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c0ec13e2-432f-46fe-ac1e-cafb806a74a0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104672025-01-09T01:13:33.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c0ec13e2-432f-46fe-ac1e-cafb806a74a0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104682025-01-09T01:13:34.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 63d61217-04cc-490e-8e30-65650365c981 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104692025-01-09T01:13:34.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 63d61217-04cc-490e-8e30-65650365c981 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104702025-01-09T01:13:34.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 63d61217-04cc-490e-8e30-65650365c981 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104712025-01-09T01:13:35.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0b67a5c-7c3d-46ac-853e-fae24aff78d3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104722025-01-09T01:13:35.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0b67a5c-7c3d-46ac-853e-fae24aff78d3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104732025-01-09T01:13:35.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0b67a5c-7c3d-46ac-853e-fae24aff78d3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104742025-01-09T01:13:36.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e42ed45-a03e-4532-98ed-97d8498d6eef roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104752025-01-09T01:13:36.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e42ed45-a03e-4532-98ed-97d8498d6eef resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104762025-01-09T01:13:36.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0e42ed45-a03e-4532-98ed-97d8498d6eef response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104772025-01-09T01:13:36.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
104782025-01-09T01:13:36.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
104792025-01-09T01:13:36.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104802025-01-09T01:13:36.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104812025-01-09T01:13:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104822025-01-09T01:13:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104832025-01-09T01:13:36.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104842025-01-09T01:13:36.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104852025-01-09T01:13:36.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.406721ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104862025-01-09T01:13:36.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104872025-01-09T01:13:36.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104882025-01-09T01:13:36.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104892025-01-09T01:13:36.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104902025-01-09T01:13:36.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104912025-01-09T01:13:36.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104922025-01-09T01:13:36.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104932025-01-09T01:13:36.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
104942025-01-09T01:13:36.944ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104952025-01-09T01:13:36.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104962025-01-09T01:13:36.956ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
104972025-01-09T01:13:36.956ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.282277ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
104982025-01-09T01:13:37.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 509c8993-5a57-4f84-8ba4-40f8e974da80 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
104992025-01-09T01:13:37.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 509c8993-5a57-4f84-8ba4-40f8e974da80 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105002025-01-09T01:13:37.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 509c8993-5a57-4f84-8ba4-40f8e974da80 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105012025-01-09T01:13:38.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c107d77-fcfc-4276-bf4e-61e83daa96ed roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105022025-01-09T01:13:38.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c107d77-fcfc-4276-bf4e-61e83daa96ed resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105032025-01-09T01:13:38.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c107d77-fcfc-4276-bf4e-61e83daa96ed response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105042025-01-09T01:13:39.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 749 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 5ea87b8f-f40a-4ef8-8b45-b1042da5a573 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
105052025-01-09T01:13:39.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21dbadf8-4b1d-479f-8a7a-a66ed04d78d1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105062025-01-09T01:13:39.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21dbadf8-4b1d-479f-8a7a-a66ed04d78d1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105072025-01-09T01:13:39.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 21dbadf8-4b1d-479f-8a7a-a66ed04d78d1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105082025-01-09T01:13:40.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 606a7228-7561-400b-b62c-3cca55dde28d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105092025-01-09T01:13:40.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 606a7228-7561-400b-b62c-3cca55dde28d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105102025-01-09T01:13:40.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 606a7228-7561-400b-b62c-3cca55dde28d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105112025-01-09T01:13:42.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 75916a71-6535-475c-b44e-4408bbb6aafc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105122025-01-09T01:13:42.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 75916a71-6535-475c-b44e-4408bbb6aafc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105132025-01-09T01:13:42.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 75916a71-6535-475c-b44e-4408bbb6aafc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105142025-01-09T01:13:43.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 687a7df6-b3bd-4f35-bc72-d86f84363ed6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105152025-01-09T01:13:43.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 687a7df6-b3bd-4f35-bc72-d86f84363ed6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105162025-01-09T01:13:43.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 687a7df6-b3bd-4f35-bc72-d86f84363ed6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105172025-01-09T01:13:44.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7b3e29b-d4cd-4012-b074-98135db7bc00 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105182025-01-09T01:13:44.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7b3e29b-d4cd-4012-b074-98135db7bc00 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105192025-01-09T01:13:44.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d7b3e29b-d4cd-4012-b074-98135db7bc00 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105202025-01-09T01:13:44.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 2ab459e2-259e-40b3-979a-dbca098e517f roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
105212025-01-09T01:13:44.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 2ab459e2-259e-40b3-979a-dbca098e517f resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
105222025-01-09T01:13:44.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 2ab459e2-259e-40b3-979a-dbca098e517f response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
105232025-01-09T01:13:44.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 21179644-4c53-422f-879d-97e043ff728f roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
105242025-01-09T01:13:44.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 21179644-4c53-422f-879d-97e043ff728f resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
105252025-01-09T01:13:44.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 21179644-4c53-422f-879d-97e043ff728f response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
105262025-01-09T01:13:45.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 174dd95f-5382-4bdd-9c5f-656552bc0305 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105272025-01-09T01:13:45.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 174dd95f-5382-4bdd-9c5f-656552bc0305 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105282025-01-09T01:13:45.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 174dd95f-5382-4bdd-9c5f-656552bc0305 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105292025-01-09T01:13:46.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3d47f2bc-43c5-4f33-a1ec-4a75beb653d4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105302025-01-09T01:13:46.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3d47f2bc-43c5-4f33-a1ec-4a75beb653d4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105312025-01-09T01:13:46.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3d47f2bc-43c5-4f33-a1ec-4a75beb653d4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
105322025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
105332025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
105342025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105352025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
105362025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
105372025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105382025-01-09T01:13:46.900ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:03:46.900390829 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105392025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
105402025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105412025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
105422025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105432025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
105442025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
105452025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
105462025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105472025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
105482025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105492025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
105502025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
105512025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105522025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105532025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105542025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105552025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105562025-01-09T01:13:46.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105572025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
105582025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
105592025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105602025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
105612025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105622025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105632025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
105642025-01-09T01:13:46.901ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
105652025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105662025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
105672025-01-09T01:13:46.901ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
105682025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
105692025-01-09T01:13:46.901ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
105702025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105712025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
105722025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
105732025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105742025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105752025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
105762025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105772025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
105782025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105792025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
105802025-01-09T01:13:46.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105812025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105822025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
105832025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105842025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
105852025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105862025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
105872025-01-09T01:13:46.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
105882025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.95\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
105892025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
105902025-01-09T01:13:46.901ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
105912025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
105922025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105932025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
105942025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
105952025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105962025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105972025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105982025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105992025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
106002025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
106012025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106022025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106032025-01-09T01:13:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 360407343 } })
106042025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
106052025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
106062025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106072025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
106082025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106092025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106102025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106112025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106122025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106132025-01-09T01:13:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 360616648 } })
106142025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106152025-01-09T01:13:46.901ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
106162025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106172025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106182025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106192025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106202025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106212025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106222025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
106232025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106242025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106252025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106262025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
106272025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106282025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
106292025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.476354ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
106302025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106312025-01-09T01:13:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106322025-01-09T01:13:46.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
106332025-01-09T01:13:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.78398ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
106342025-01-09T01:13:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106352025-01-09T01:13:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106362025-01-09T01:13:46.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:03:46.900390829 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
106372025-01-09T01:13:46.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.48017ms iteration = 11 status = {"expiration":"2025-01-09T01:03:46.900390829Z","pruned":[]}
106382025-01-09T01:13:46.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 364922065 } })
106392025-01-09T01:13:46.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106402025-01-09T01:13:46.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
106412025-01-09T01:13:46.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 365833885 } })
106422025-01-09T01:13:46.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
106432025-01-09T01:13:46.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106442025-01-09T01:13:46.909ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.923369ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106452025-01-09T01:13:46.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106462025-01-09T01:13:46.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106472025-01-09T01:13:46.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106482025-01-09T01:13:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106492025-01-09T01:13:46.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106502025-01-09T01:13:46.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106512025-01-09T01:13:46.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106522025-01-09T01:13:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106532025-01-09T01:13:46.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.960318ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
106542025-01-09T01:13:46.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106552025-01-09T01:13:46.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106562025-01-09T01:13:46.920ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.52314ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
106572025-01-09T01:13:46.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106582025-01-09T01:13:46.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106592025-01-09T01:13:46.921ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106602025-01-09T01:13:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106612025-01-09T01:13:46.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106622025-01-09T01:13:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106632025-01-09T01:13:46.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106642025-01-09T01:13:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106652025-01-09T01:13:46.925ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106662025-01-09T01:13:46.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106672025-01-09T01:13:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106682025-01-09T01:13:46.928ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106692025-01-09T01:13:46.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106702025-01-09T01:13:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106712025-01-09T01:13:46.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106722025-01-09T01:13:46.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106732025-01-09T01:13:46.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106742025-01-09T01:13:46.937ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 396288173 } })
106752025-01-09T01:13:46.937ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
106762025-01-09T01:13:46.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106772025-01-09T01:13:46.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106782025-01-09T01:13:46.940ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106792025-01-09T01:13:46.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106802025-01-09T01:13:46.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106812025-01-09T01:13:46.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106822025-01-09T01:13:46.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106832025-01-09T01:13:46.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106842025-01-09T01:13:46.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106852025-01-09T01:13:46.945ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106862025-01-09T01:13:46.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106872025-01-09T01:13:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106882025-01-09T01:13:46.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106892025-01-09T01:13:46.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106902025-01-09T01:13:46.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106912025-01-09T01:13:46.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106922025-01-09T01:13:46.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106932025-01-09T01:13:46.954ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106942025-01-09T01:13:46.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106952025-01-09T01:13:46.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106962025-01-09T01:13:46.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106972025-01-09T01:13:46.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106982025-01-09T01:13:46.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106992025-01-09T01:13:46.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107002025-01-09T01:13:46.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107012025-01-09T01:13:46.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107022025-01-09T01:13:46.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107032025-01-09T01:13:46.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107042025-01-09T01:13:46.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107052025-01-09T01:13:46.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107062025-01-09T01:13:46.963ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
107072025-01-09T01:13:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 62.776357ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
107082025-01-09T01:13:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107092025-01-09T01:13:46.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107102025-01-09T01:13:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107112025-01-09T01:13:46.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107122025-01-09T01:13:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107132025-01-09T01:13:46.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107142025-01-09T01:13:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107152025-01-09T01:13:46.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 69.323445ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107162025-01-09T01:13:46.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.301311ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
107172025-01-09T01:13:46.976ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107182025-01-09T01:13:46.976ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107192025-01-09T01:13:46.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107202025-01-09T01:13:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107212025-01-09T01:13:46.979ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107222025-01-09T01:13:46.979ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107232025-01-09T01:13:46.979ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.304317ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107242025-01-09T01:13:46.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107252025-01-09T01:13:46.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107262025-01-09T01:13:46.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107272025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
107282025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107292025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107302025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107312025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107322025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107332025-01-09T01:13:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107342025-01-09T01:13:46.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.788683ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107352025-01-09T01:13:46.983ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107362025-01-09T01:13:46.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107372025-01-09T01:13:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
107382025-01-09T01:13:46.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107392025-01-09T01:13:46.984ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
107402025-01-09T01:13:46.984ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
107412025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.624116ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
107422025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107432025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107442025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107452025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107462025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107472025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107482025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107492025-01-09T01:13:46.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107502025-01-09T01:13:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107512025-01-09T01:13:46.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107522025-01-09T01:13:46.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.514905ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107532025-01-09T01:13:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107542025-01-09T01:13:46.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107552025-01-09T01:13:46.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107562025-01-09T01:13:46.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107572025-01-09T01:13:46.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107582025-01-09T01:13:46.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107592025-01-09T01:13:46.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107602025-01-09T01:13:46.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107612025-01-09T01:13:46.996ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107622025-01-09T01:13:46.997ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
107632025-01-09T01:13:46.997ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
107642025-01-09T01:13:46.997ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.836942ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
107652025-01-09T01:13:46.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107662025-01-09T01:13:46.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107672025-01-09T01:13:46.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107682025-01-09T01:13:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107692025-01-09T01:13:47.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107702025-01-09T01:13:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107712025-01-09T01:13:47.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107722025-01-09T01:13:47.003ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107732025-01-09T01:13:47.003ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
107742025-01-09T01:13:47.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107752025-01-09T01:13:47.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107762025-01-09T01:13:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
107772025-01-09T01:13:47.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107782025-01-09T01:13:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107792025-01-09T01:13:47.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107802025-01-09T01:13:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107812025-01-09T01:13:47.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107822025-01-09T01:13:47.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107832025-01-09T01:13:47.016ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
107842025-01-09T01:13:47.016ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 115.70955ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
107852025-01-09T01:13:47.019ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
107862025-01-09T01:13:47.019ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107872025-01-09T01:13:47.019ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
107882025-01-09T01:13:47.019ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 118.846821ms iteration = 11 status = {"generation":2}
107892025-01-09T01:13:47.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107902025-01-09T01:13:47.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107912025-01-09T01:13:47.031ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107922025-01-09T01:13:47.031ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107932025-01-09T01:13:47.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107942025-01-09T01:13:47.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107952025-01-09T01:13:47.031ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
107962025-01-09T01:13:47.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107972025-01-09T01:13:47.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
107982025-01-09T01:13:47.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.388765ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
107992025-01-09T01:13:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108002025-01-09T01:13:47.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108012025-01-09T01:13:47.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108022025-01-09T01:13:47.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108032025-01-09T01:13:47.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.240986ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108042025-01-09T01:13:47.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
108052025-01-09T01:13:47.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108062025-01-09T01:13:47.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108072025-01-09T01:13:47.044ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.764104ms iteration = 21 status = 0
108082025-01-09T01:13:47.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108092025-01-09T01:13:47.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108102025-01-09T01:13:47.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108112025-01-09T01:13:47.053ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
108122025-01-09T01:13:47.053ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
108132025-01-09T01:13:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108142025-01-09T01:13:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108152025-01-09T01:13:47.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108162025-01-09T01:13:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108172025-01-09T01:13:47.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108182025-01-09T01:13:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108192025-01-09T01:13:47.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108202025-01-09T01:13:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108212025-01-09T01:13:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108222025-01-09T01:13:47.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108232025-01-09T01:13:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108242025-01-09T01:13:47.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108252025-01-09T01:13:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108262025-01-09T01:13:47.063ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108272025-01-09T01:13:47.063ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108282025-01-09T01:13:47.063ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
108292025-01-09T01:13:47.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 163.412567ms iteration = 11 status = {"generation":1}
108302025-01-09T01:13:47.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108312025-01-09T01:13:47.067ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108322025-01-09T01:13:47.067ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fa9f555-2f49-4c4c-8a31-045c5a4bdb86", "content-length": "26", "date": "Thu, 09 Jan 2025 01:13:46 GMT"} })
108332025-01-09T01:13:47.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108342025-01-09T01:13:47.069ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108352025-01-09T01:13:47.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
108362025-01-09T01:13:47.073ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108372025-01-09T01:13:47.073ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "575fe7d9-0d0c-435d-abee-795f636223d3", "content-length": "26", "date": "Thu, 09 Jan 2025 01:13:46 GMT"} })
108382025-01-09T01:13:47.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108392025-01-09T01:13:47.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
108402025-01-09T01:13:47.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108412025-01-09T01:13:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108422025-01-09T01:13:47.077ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108432025-01-09T01:13:47.077ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
108442025-01-09T01:13:47.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.130984ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
108452025-01-09T01:13:47.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16240f7b-09bb-4783-b692-ead0c126056c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
108462025-01-09T01:13:47.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16240f7b-09bb-4783-b692-ead0c126056c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
108472025-01-09T01:13:47.133ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
108482025-01-09T01:13:47.133ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 232.071956ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
108492025-01-09T01:13:47.138ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 237.305265ms iteration = 23 status = {"physical_disks_added":0}
108502025-01-09T01:13:47.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108512025-01-09T01:13:47.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
108522025-01-09T01:13:47.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "de052280-859f-4215-85fc-2da18b9b72d2", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108532025-01-09T01:13:47.209ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108542025-01-09T01:13:47.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2d4e5c75-1e29-4217-9429-36f81e94c58a", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108552025-01-09T01:13:47.211ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108562025-01-09T01:13:47.213ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108572025-01-09T01:13:47.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.990712ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108582025-01-09T01:13:47.229ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108592025-01-09T01:13:47.230ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f547c7e-a454-48a0-a21f-7caca91c777c", "content-length": "1", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
108602025-01-09T01:13:47.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108612025-01-09T01:13:47.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108622025-01-09T01:13:47.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108632025-01-09T01:13:47.262ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108642025-01-09T01:13:47.263ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bd20c91-e4a4-4f09-b92d-860133778251", "content-length": "26", "date": "Thu, 09 Jan 2025 01:13:46 GMT"} })
108652025-01-09T01:13:47.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108662025-01-09T01:13:47.264ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108672025-01-09T01:13:47.369ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 468.92375ms iteration = 21 status = {}
108682025-01-09T01:13:47.377ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108692025-01-09T01:13:47.378ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108702025-01-09T01:13:47.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108712025-01-09T01:13:47.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108722025-01-09T01:13:47.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16240f7b-09bb-4783-b692-ead0c126056c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
108732025-01-09T01:13:47.381ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 480.935701ms iteration = 21 status = null
108742025-01-09T01:13:47.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108752025-01-09T01:13:47.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108762025-01-09T01:13:47.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108772025-01-09T01:13:47.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108782025-01-09T01:13:47.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108792025-01-09T01:13:47.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108802025-01-09T01:13:47.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108812025-01-09T01:13:47.388ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
108822025-01-09T01:13:47.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108832025-01-09T01:13:47.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108842025-01-09T01:13:47.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108852025-01-09T01:13:47.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108862025-01-09T01:13:47.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108872025-01-09T01:13:47.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108882025-01-09T01:13:47.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108892025-01-09T01:13:47.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108902025-01-09T01:13:47.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108912025-01-09T01:13:47.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108922025-01-09T01:13:47.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108932025-01-09T01:13:47.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108942025-01-09T01:13:47.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108952025-01-09T01:13:47.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108962025-01-09T01:13:47.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108972025-01-09T01:13:47.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108982025-01-09T01:13:47.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108992025-01-09T01:13:47.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109002025-01-09T01:13:47.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109012025-01-09T01:13:47.407ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "839594ed-c238-4b94-901b-7c3977215223", "content-length": "372", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
109022025-01-09T01:13:47.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109032025-01-09T01:13:47.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109042025-01-09T01:13:47.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109052025-01-09T01:13:47.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109062025-01-09T01:13:47.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109072025-01-09T01:13:47.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109082025-01-09T01:13:47.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109092025-01-09T01:13:47.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109102025-01-09T01:13:47.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109112025-01-09T01:13:47.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109122025-01-09T01:13:47.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109132025-01-09T01:13:47.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109142025-01-09T01:13:47.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109152025-01-09T01:13:47.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109162025-01-09T01:13:47.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109172025-01-09T01:13:47.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109182025-01-09T01:13:47.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109192025-01-09T01:13:47.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109202025-01-09T01:13:47.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109212025-01-09T01:13:47.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109222025-01-09T01:13:47.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109232025-01-09T01:13:47.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109242025-01-09T01:13:47.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109252025-01-09T01:13:47.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109262025-01-09T01:13:47.431ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
109272025-01-09T01:13:47.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109282025-01-09T01:13:47.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109292025-01-09T01:13:47.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109302025-01-09T01:13:47.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109312025-01-09T01:13:47.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109322025-01-09T01:13:47.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109332025-01-09T01:13:47.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109342025-01-09T01:13:47.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109352025-01-09T01:13:47.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109362025-01-09T01:13:47.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109372025-01-09T01:13:47.441ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109382025-01-09T01:13:47.441ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
109392025-01-09T01:13:47.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109402025-01-09T01:13:47.441ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "000143ed-ee1d-4997-9b8f-cf9cd17b699d", "content-length": "134", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
109412025-01-09T01:13:47.441ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109422025-01-09T01:13:47.441ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
109432025-01-09T01:13:47.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109442025-01-09T01:13:47.442ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e46849cf-eac3-4310-9f97-8620ee35c0c9", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109452025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109462025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109472025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109482025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109492025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109502025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109512025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109522025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109532025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109542025-01-09T01:13:47.442ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
109552025-01-09T01:13:47.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109562025-01-09T01:13:47.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109572025-01-09T01:13:47.443ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "25569ad6-db20-4586-8e4a-b18f5438ca09", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109582025-01-09T01:13:47.443ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109592025-01-09T01:13:47.446ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f8c240df-9613-40c1-b7b4-77c39feeba51", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109602025-01-09T01:13:47.446ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109612025-01-09T01:13:47.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109622025-01-09T01:13:47.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109632025-01-09T01:13:47.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "64db1129-9868-4b59-b406-4fd7a4466b8d", "content-length": "2", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
109642025-01-09T01:13:47.448ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109652025-01-09T01:13:47.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "752f9203-b705-4f3f-9635-81bb3948b9fb", "content-length": "52", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
109662025-01-09T01:13:47.448ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
109672025-01-09T01:13:47.448ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109682025-01-09T01:13:47.448ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
109692025-01-09T01:13:47.449ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 548.468874ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
109702025-01-09T01:13:47.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109712025-01-09T01:13:47.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109722025-01-09T01:13:47.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109732025-01-09T01:13:47.457ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109742025-01-09T01:13:47.457ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109752025-01-09T01:13:47.458ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0338b90e-9ec9-4e98-ac2d-44cbbb13d0fd", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
109762025-01-09T01:13:47.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109772025-01-09T01:13:47.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109782025-01-09T01:13:47.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109792025-01-09T01:13:47.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109802025-01-09T01:13:47.462ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 5082dfc8-feb0-4452-a8c4-3c0037101230, kind: Service { id: 71878588-3bc5-4be9-bddb-893f09285184 }, name: Name("external-dns-71878588-3bc5-4be9-bddb-893f09285184"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 84c8b3b4-9160-4f8a-9f93-e97bdb5fa721, kind: Service { id: 870344ce-2728-444f-8d5a-e3771e15477e }, name: Name("external-dns-870344ce-2728-444f-8d5a-e3771e15477e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 234])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 32dc4ecd-b53e-48ec-96da-e27f9d50a7c1, kind: Service { id: cffb0aad-1932-4a44-891c-2739991d1934 }, name: Name("nexus-cffb0aad-1932-4a44-891c-2739991d1934"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5bb6cca4-8c89-42c7-8517-bbec55a75150, kind: Service { id: 5236fac0-d91c-403e-8658-32167d628d4d }, name: Name("nexus-5236fac0-d91c-403e-8658-32167d628d4d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7464f2e2-2881-4143-9c24-14f2de0a4d6a, kind: Service { id: bc5aeb1b-883b-4e3c-84e4-bb4b98458327 }, name: Name("nexus-bc5aeb1b-883b-4e3c-84e4-bb4b98458327"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
109812025-01-09T01:13:47.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109822025-01-09T01:13:47.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109832025-01-09T01:13:47.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109842025-01-09T01:13:47.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109852025-01-09T01:13:47.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109862025-01-09T01:13:47.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109872025-01-09T01:13:47.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109882025-01-09T01:13:47.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109892025-01-09T01:13:47.467ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109902025-01-09T01:13:47.467ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5082dfc8-feb0-4452-a8c4-3c0037101230, kind: Service { id: 71878588-3bc5-4be9-bddb-893f09285184 }, name: Name("external-dns-71878588-3bc5-4be9-bddb-893f09285184"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 84c8b3b4-9160-4f8a-9f93-e97bdb5fa721, kind: Service { id: 870344ce-2728-444f-8d5a-e3771e15477e }, name: Name("external-dns-870344ce-2728-444f-8d5a-e3771e15477e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 234])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32dc4ecd-b53e-48ec-96da-e27f9d50a7c1, kind: Service { id: cffb0aad-1932-4a44-891c-2739991d1934 }, name: Name("nexus-cffb0aad-1932-4a44-891c-2739991d1934"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5bb6cca4-8c89-42c7-8517-bbec55a75150, kind: Service { id: 5236fac0-d91c-403e-8658-32167d628d4d }, name: Name("nexus-5236fac0-d91c-403e-8658-32167d628d4d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7464f2e2-2881-4143-9c24-14f2de0a4d6a, kind: Service { id: bc5aeb1b-883b-4e3c-84e4-bb4b98458327 }, name: Name("nexus-bc5aeb1b-883b-4e3c-84e4-bb4b98458327"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109912025-01-09T01:13:47.467ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109922025-01-09T01:13:47.468ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109932025-01-09T01:13:47.468ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109942025-01-09T01:13:47.470ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06960b3d-99dd-463c-9fa9-677503df6f7b", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
109952025-01-09T01:13:47.472ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 571.430333ms iteration = 21 status = {}
109962025-01-09T01:13:47.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109972025-01-09T01:13:47.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109982025-01-09T01:13:47.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109992025-01-09T01:13:47.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110002025-01-09T01:13:47.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110012025-01-09T01:13:47.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110022025-01-09T01:13:47.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110032025-01-09T01:13:47.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110042025-01-09T01:13:47.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110052025-01-09T01:13:47.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110062025-01-09T01:13:47.542ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110072025-01-09T01:13:47.545ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a2f3de7-5008-4644-b251-6611514b0b89", "content-length": "691", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110082025-01-09T01:13:47.545ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
110092025-01-09T01:13:47.545ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
110102025-01-09T01:13:47.545ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
110112025-01-09T01:13:47.547ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 645.863822ms iteration = 21 status = {}
110122025-01-09T01:13:47.581ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "286257fc-4d29-455f-866e-b0b3068d73ea", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110132025-01-09T01:13:47.581ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
110142025-01-09T01:13:47.581ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110152025-01-09T01:13:47.581ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, time_created: 2025-01-09T01:03:45.090062Z, time_modified: 2025-01-09T01:03:45.090062Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
110162025-01-09T01:13:47.581ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
110172025-01-09T01:13:47.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110182025-01-09T01:13:47.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110192025-01-09T01:13:47.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110202025-01-09T01:13:47.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110212025-01-09T01:13:47.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110222025-01-09T01:13:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
110232025-01-09T01:13:47.588ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e79c44-6a38-44df-b715-0690a4a32fd3", "content-length": "682", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110242025-01-09T01:13:47.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110252025-01-09T01:13:47.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110262025-01-09T01:13:47.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110272025-01-09T01:13:47.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110282025-01-09T01:13:47.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110292025-01-09T01:13:47.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110302025-01-09T01:13:47.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110312025-01-09T01:13:47.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110322025-01-09T01:13:47.605ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.423453ms iteration = 21 status = {}
110332025-01-09T01:13:47.619ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
110342025-01-09T01:13:47.621ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "53724ecc-828d-4f45-9959-2040d28d543a", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110352025-01-09T01:13:47.623ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
110362025-01-09T01:13:47.623ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 722.276376ms
110372025-01-09T01:13:47.623ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 722.284706ms iteration = 3 status = {}
110382025-01-09T01:13:48.350ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
110392025-01-09T01:13:48.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110402025-01-09T01:13:48.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110412025-01-09T01:13:48.352ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110422025-01-09T01:13:48.354ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110432025-01-09T01:13:48.354ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110442025-01-09T01:13:48.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110452025-01-09T01:13:48.358ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(a4ece29b-1987-401d-9e03-78c91a55a3be, 0), (84428d33-17e2-40a7-95fe-34a7c917e0b4, 0), (33cc2200-e0c9-4cd0-9f48-4735e7b1abb1, 0), (38ac7841-7edb-4f2a-8ae5-b5455f7329b3, 0)] collection_id = a4ece29b-1987-401d-9e03-78c91a55a3be
110462025-01-09T01:13:48.358ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110472025-01-09T01:13:48.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110482025-01-09T01:13:48.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36cbbb96-87ea-429e-8aff-b2f570ae4798 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
110492025-01-09T01:13:48.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36cbbb96-87ea-429e-8aff-b2f570ae4798 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
110502025-01-09T01:13:48.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36cbbb96-87ea-429e-8aff-b2f570ae4798 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
110512025-01-09T01:13:48.447ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = a4ece29b-1987-401d-9e03-78c91a55a3be file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
110522025-01-09T01:13:48.447ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110532025-01-09T01:13:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110542025-01-09T01:13:48.451ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(84428d33-17e2-40a7-95fe-34a7c917e0b4, 0), (33cc2200-e0c9-4cd0-9f48-4735e7b1abb1, 0), (38ac7841-7edb-4f2a-8ae5-b5455f7329b3, 0), (5c090022-8b16-4bca-9ca9-806101656747, 0)] collection_id = 84428d33-17e2-40a7-95fe-34a7c917e0b4
110552025-01-09T01:13:48.451ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110562025-01-09T01:13:48.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110572025-01-09T01:13:48.504ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 84428d33-17e2-40a7-95fe-34a7c917e0b4 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
110582025-01-09T01:13:48.504ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110592025-01-09T01:13:48.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110602025-01-09T01:13:48.508ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(33cc2200-e0c9-4cd0-9f48-4735e7b1abb1, 0), (38ac7841-7edb-4f2a-8ae5-b5455f7329b3, 0), (5c090022-8b16-4bca-9ca9-806101656747, 0)]
110612025-01-09T01:13:48.508ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 967688216 } })
110622025-01-09T01:13:48.539ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
110632025-01-09T01:13:48.539ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
110642025-01-09T01:13:48.539ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
110652025-01-09T01:13:48.540ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd273343-f328-4383-89b2-a5a0c676231f", "content-length": "476", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110662025-01-09T01:13:48.540ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
110672025-01-09T01:13:48.540ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "55196eee-65ca-4ea3-b09c-cdca98ba355a", "content-length": "734", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110682025-01-09T01:13:48.540ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
110692025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "46c98a58-63d2-4b1a-93b7-2b5d9ca9fcbb", "content-length": "111", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110702025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
110712025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e00e3b2a-b3d7-44f8-b932-d6820215bd48", "content-length": "111", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110722025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
110732025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cf7b142-5693-4e92-a4d6-d672e18e8719", "content-length": "167", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110742025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
110752025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb59d58b-ba86-4950-9e42-4fdc823a88eb", "content-length": "167", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110762025-01-09T01:13:48.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
110772025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e16c74b-a072-44fa-83f0-d78d5871df60", "content-length": "175", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110782025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
110792025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cffcdef7-8f87-4ef2-a99b-971d00ca7bd2", "content-length": "175", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110802025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
110812025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "01a03989-c370-45d5-a8fc-7e1b0214ca67", "content-length": "702", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110822025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110832025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0148915f-2a39-42c9-8f81-0bbc63bc0925", "content-length": "727", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110842025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110852025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d798ee7f-6361-498d-9666-85fdc39943c4", "content-length": "729", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110862025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
110872025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbe32a21-d89f-4528-a1ea-8d536e279be9", "content-length": "728", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110882025-01-09T01:13:48.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
110892025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a4de4b8-26dd-40e1-affa-7f0cd36fb722", "content-length": "722", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110902025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
110912025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9b41763-70b0-4b1b-b07a-54b3555cf200", "content-length": "109", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110922025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
110932025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8432dda3-2c63-45a5-9a28-94f39b80dcea", "content-length": "109", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110942025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
110952025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f3c7cd7-04ac-4543-915c-68a1542c1d70", "content-length": "169", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110962025-01-09T01:13:48.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
110972025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5d974b6-81fa-403c-8304-f5eb320fd310", "content-length": "169", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
110982025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
110992025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "51e78c0f-6a9e-4358-af99-ea146f9b1a6d", "content-length": "178", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
111002025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
111012025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f81f6f-08a5-4434-bf9f-b01e3901e4a6", "content-length": "178", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
111022025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
111032025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c79b9d3-d871-49d3-ac54-991fedd4bfd5", "content-length": "702", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
111042025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111052025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "542a1c73-65fd-4ea3-927a-b42d73be23e2", "content-length": "727", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
111062025-01-09T01:13:48.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111072025-01-09T01:13:48.545ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa9b188d-9726-497c-85ab-9dc2b5a574d5", "content-length": "729", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
111082025-01-09T01:13:48.545ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111092025-01-09T01:13:48.545ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc358613-9ded-4c91-95f0-94ec23f5ac06", "content-length": "728", "date": "Thu, 09 Jan 2025 01:13:47 GMT"} })
111102025-01-09T01:13:48.545ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111112025-01-09T01:13:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111122025-01-09T01:13:48.546ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111132025-01-09T01:13:48.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111142025-01-09T01:13:48.548ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111152025-01-09T01:13:48.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111162025-01-09T01:13:48.550ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111172025-01-09T01:13:48.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111182025-01-09T01:13:48.552ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111192025-01-09T01:13:48.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111202025-01-09T01:13:48.584ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
111212025-01-09T01:13:48.584ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
111222025-01-09T01:13:48.792ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe792a5-051a-440b-b349-1f1f54543b3a", "content-length": "30802", "date": "Thu, 09 Jan 2025 01:13:48 GMT"} })
111232025-01-09T01:13:48.793ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111242025-01-09T01:13:48.793ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111252025-01-09T01:13:48.793ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
111262025-01-09T01:13:48.795ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111272025-01-09T01:13:48.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111282025-01-09T01:13:48.797ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111292025-01-09T01:13:48.799ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
111302025-01-09T01:13:48.799ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111312025-01-09T01:13:48.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111322025-01-09T01:13:48.967ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0383acee-6260-48a0-8b67-f50a5fb9987a file = nexus/db-queries/src/db/datastore/inventory.rs:1010
111332025-01-09T01:13:48.967ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0383acee-6260-48a0-8b67-f50a5fb9987a time_started = 2025-01-09 01:13:48.539951 UTC
111342025-01-09T01:13:48.967ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 617.256656ms iteration = 3 status = {"collection_id":"0383acee-6260-48a0-8b67-f50a5fb9987a","time_done":"2025-01-09 01:13:48.793889 UTC","time_started":"2025-01-09 01:13:48.539951 UTC"}
111352025-01-09T01:13:48.967ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
111362025-01-09T01:13:48.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111372025-01-09T01:13:48.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111382025-01-09T01:13:48.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111392025-01-09T01:13:48.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111402025-01-09T01:13:48.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111412025-01-09T01:13:48.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111422025-01-09T01:13:48.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111432025-01-09T01:13:48.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111442025-01-09T01:13:48.975ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111452025-01-09T01:13:48.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111462025-01-09T01:13:48.977ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111472025-01-09T01:13:48.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111482025-01-09T01:13:49.016ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 48.937335ms iteration = 24 status = {"physical_disks_added":0}
111492025-01-09T01:13:49.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a0acab41-64cd-41dc-9262-373a3de5ffe2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111502025-01-09T01:13:49.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a0acab41-64cd-41dc-9262-373a3de5ffe2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111512025-01-09T01:13:49.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a0acab41-64cd-41dc-9262-373a3de5ffe2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111522025-01-09T01:13:49.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 699 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 9cfa6097-41e3-4fed-96c3-683ce2dfc3ab response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
111532025-01-09T01:13:50.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 361fe6de-2b67-47c0-a67e-9464b3c0cad3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111542025-01-09T01:13:50.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 361fe6de-2b67-47c0-a67e-9464b3c0cad3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111552025-01-09T01:13:50.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 361fe6de-2b67-47c0-a67e-9464b3c0cad3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111562025-01-09T01:13:51.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fde473c4-0bee-453c-8394-863f5398f656 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111572025-01-09T01:13:51.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fde473c4-0bee-453c-8394-863f5398f656 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111582025-01-09T01:13:51.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fde473c4-0bee-453c-8394-863f5398f656 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111592025-01-09T01:13:52.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b035c92d-876d-4abe-b1fb-94e703be1fb4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111602025-01-09T01:13:52.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b035c92d-876d-4abe-b1fb-94e703be1fb4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111612025-01-09T01:13:52.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b035c92d-876d-4abe-b1fb-94e703be1fb4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111622025-01-09T01:13:53.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19e28e30-f58f-4ea5-a5a3-00cccc8eaacd roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111632025-01-09T01:13:53.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19e28e30-f58f-4ea5-a5a3-00cccc8eaacd resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111642025-01-09T01:13:53.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 19e28e30-f58f-4ea5-a5a3-00cccc8eaacd response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111652025-01-09T01:13:54.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5b3c8a0a-c2e6-4551-9de1-ffa083a80642 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111662025-01-09T01:13:54.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5b3c8a0a-c2e6-4551-9de1-ffa083a80642 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111672025-01-09T01:13:54.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5b3c8a0a-c2e6-4551-9de1-ffa083a80642 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111682025-01-09T01:13:55.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86435b76-420d-41ec-afba-1cd911763da1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111692025-01-09T01:13:55.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86435b76-420d-41ec-afba-1cd911763da1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111702025-01-09T01:13:55.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 86435b76-420d-41ec-afba-1cd911763da1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111712025-01-09T01:13:56.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 22c1cdcf-58a0-43c7-900a-066bd94841dc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111722025-01-09T01:13:56.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 22c1cdcf-58a0-43c7-900a-066bd94841dc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111732025-01-09T01:13:56.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 22c1cdcf-58a0-43c7-900a-066bd94841dc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111742025-01-09T01:13:56.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
111752025-01-09T01:13:56.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
111762025-01-09T01:13:56.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111772025-01-09T01:13:56.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111782025-01-09T01:13:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111792025-01-09T01:13:56.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111802025-01-09T01:13:56.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111812025-01-09T01:13:56.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111822025-01-09T01:13:56.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111832025-01-09T01:13:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111842025-01-09T01:13:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111852025-01-09T01:13:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111862025-01-09T01:13:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111872025-01-09T01:13:56.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111882025-01-09T01:13:56.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111892025-01-09T01:13:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
111902025-01-09T01:13:56.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111912025-01-09T01:13:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111922025-01-09T01:13:56.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
111932025-01-09T01:13:56.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.673584ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
111942025-01-09T01:13:56.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.575676ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111952025-01-09T01:13:57.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6c974b14-c2d5-4bb4-a737-d10eece88892 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111962025-01-09T01:13:57.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6c974b14-c2d5-4bb4-a737-d10eece88892 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111972025-01-09T01:13:57.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6c974b14-c2d5-4bb4-a737-d10eece88892 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111982025-01-09T01:13:58.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1138af1b-a580-4697-a49f-7c1e2b08a471 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
111992025-01-09T01:13:58.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1138af1b-a580-4697-a49f-7c1e2b08a471 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112002025-01-09T01:13:58.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1138af1b-a580-4697-a49f-7c1e2b08a471 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112012025-01-09T01:13:59.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ed553176-0430-43ea-81c2-97b92335ce2b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112022025-01-09T01:13:59.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ed553176-0430-43ea-81c2-97b92335ce2b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112032025-01-09T01:13:59.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ed553176-0430-43ea-81c2-97b92335ce2b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112042025-01-09T01:13:59.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = c78600b2-5fe8-40ed-9293-c64b8e7c5a15 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
112052025-01-09T01:14:00.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fb327a5-1985-4f73-86b0-2c1098975264 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112062025-01-09T01:14:00.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fb327a5-1985-4f73-86b0-2c1098975264 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112072025-01-09T01:14:00.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6fb327a5-1985-4f73-86b0-2c1098975264 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112082025-01-09T01:14:01.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36852dd6-f9da-4818-bae0-d2ffe4055a6f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112092025-01-09T01:14:01.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36852dd6-f9da-4818-bae0-d2ffe4055a6f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112102025-01-09T01:14:01.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 36852dd6-f9da-4818-bae0-d2ffe4055a6f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112112025-01-09T01:14:02.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f7a8ef9-8940-4ae5-9cb8-45d5f0c9ae80 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112122025-01-09T01:14:02.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f7a8ef9-8940-4ae5-9cb8-45d5f0c9ae80 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112132025-01-09T01:14:02.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1f7a8ef9-8940-4ae5-9cb8-45d5f0c9ae80 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112142025-01-09T01:14:03.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4575dbbd-930f-48ee-a843-138081f1274d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112152025-01-09T01:14:03.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4575dbbd-930f-48ee-a843-138081f1274d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112162025-01-09T01:14:03.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4575dbbd-930f-48ee-a843-138081f1274d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112172025-01-09T01:14:04.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c6bb97b-ff8a-4657-8789-c0eb03778b14 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112182025-01-09T01:14:04.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c6bb97b-ff8a-4657-8789-c0eb03778b14 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112192025-01-09T01:14:04.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4c6bb97b-ff8a-4657-8789-c0eb03778b14 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112202025-01-09T01:14:05.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0661917-b399-4686-bf8c-12f6f9e63d06 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112212025-01-09T01:14:05.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0661917-b399-4686-bf8c-12f6f9e63d06 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112222025-01-09T01:14:05.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e0661917-b399-4686-bf8c-12f6f9e63d06 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112232025-01-09T01:14:06.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7d9dbb34-6cf3-4248-b441-2199ce8b7181 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112242025-01-09T01:14:06.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7d9dbb34-6cf3-4248-b441-2199ce8b7181 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112252025-01-09T01:14:06.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7d9dbb34-6cf3-4248-b441-2199ce8b7181 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112262025-01-09T01:14:06.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
112272025-01-09T01:14:06.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
112282025-01-09T01:14:06.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112292025-01-09T01:14:06.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112302025-01-09T01:14:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112312025-01-09T01:14:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112322025-01-09T01:14:06.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112332025-01-09T01:14:06.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112342025-01-09T01:14:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112352025-01-09T01:14:06.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.244006ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112362025-01-09T01:14:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112372025-01-09T01:14:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112382025-01-09T01:14:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112392025-01-09T01:14:06.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112402025-01-09T01:14:06.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112412025-01-09T01:14:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112422025-01-09T01:14:06.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
112432025-01-09T01:14:06.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112442025-01-09T01:14:06.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112452025-01-09T01:14:06.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
112462025-01-09T01:14:06.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.459837ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
112472025-01-09T01:14:07.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67b6343d-16ac-4039-9ab6-6f13b8e149ba roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112482025-01-09T01:14:07.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67b6343d-16ac-4039-9ab6-6f13b8e149ba resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112492025-01-09T01:14:07.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 67b6343d-16ac-4039-9ab6-6f13b8e149ba response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112502025-01-09T01:14:08.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8db13f21-914c-419b-ae8e-b9a90be7cca2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112512025-01-09T01:14:08.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8db13f21-914c-419b-ae8e-b9a90be7cca2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112522025-01-09T01:14:08.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8db13f21-914c-419b-ae8e-b9a90be7cca2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112532025-01-09T01:14:09.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 910d63e9-a172-4a2c-8900-d304649964c2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112542025-01-09T01:14:09.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 910d63e9-a172-4a2c-8900-d304649964c2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112552025-01-09T01:14:09.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 910d63e9-a172-4a2c-8900-d304649964c2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112562025-01-09T01:14:09.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 415 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 66d4c2ad-4435-47f9-8c81-07dad989f716 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
112572025-01-09T01:14:10.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9a3a1a69-e2c2-431b-ba6c-e4c44b1f15b6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112582025-01-09T01:14:10.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9a3a1a69-e2c2-431b-ba6c-e4c44b1f15b6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112592025-01-09T01:14:10.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9a3a1a69-e2c2-431b-ba6c-e4c44b1f15b6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112602025-01-09T01:14:11.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 888bc6c6-3c13-406b-9393-b4a025b189e4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112612025-01-09T01:14:11.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 888bc6c6-3c13-406b-9393-b4a025b189e4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112622025-01-09T01:14:11.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 888bc6c6-3c13-406b-9393-b4a025b189e4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112632025-01-09T01:14:12.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b4c52c2-5c80-46c9-b0bd-d40724e1e31e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112642025-01-09T01:14:12.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b4c52c2-5c80-46c9-b0bd-d40724e1e31e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112652025-01-09T01:14:12.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b4c52c2-5c80-46c9-b0bd-d40724e1e31e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112662025-01-09T01:14:13.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b39a5faf-421e-46dd-8f07-da01c73acaa0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112672025-01-09T01:14:13.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b39a5faf-421e-46dd-8f07-da01c73acaa0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112682025-01-09T01:14:13.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b39a5faf-421e-46dd-8f07-da01c73acaa0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112692025-01-09T01:14:15.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f39f8d0c-723a-4476-9218-d6b027cea8d4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112702025-01-09T01:14:15.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f39f8d0c-723a-4476-9218-d6b027cea8d4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112712025-01-09T01:14:15.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f39f8d0c-723a-4476-9218-d6b027cea8d4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112722025-01-09T01:14:16.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1a245aa4-825f-4818-96f0-c001e165786b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112732025-01-09T01:14:16.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1a245aa4-825f-4818-96f0-c001e165786b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112742025-01-09T01:14:16.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1a245aa4-825f-4818-96f0-c001e165786b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
112752025-01-09T01:14:16.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
112762025-01-09T01:14:16.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112772025-01-09T01:14:16.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
112782025-01-09T01:14:16.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112792025-01-09T01:14:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112802025-01-09T01:14:16.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112812025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
112822025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
112832025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
112842025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
112852025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112862025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112872025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
112882025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112892025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
112902025-01-09T01:14:16.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112912025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
112922025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112932025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112942025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
112952025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
112962025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112972025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
112982025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112992025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
113002025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113012025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
113022025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113032025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
113042025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
113052025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113062025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
113072025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113082025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
113092025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113102025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
113112025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113122025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113132025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
113142025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113152025-01-09T01:14:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113162025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113172025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113182025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113192025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
113202025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113212025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113222025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113232025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113242025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113252025-01-09T01:14:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113262025-01-09T01:14:16.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1700, tv_nsec: 365863558 } })
113272025-01-09T01:14:16.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
113282025-01-09T01:14:16.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1700, tv_nsec: 366593855 } })
113292025-01-09T01:14:16.908ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
113302025-01-09T01:14:16.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.688174ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
113312025-01-09T01:14:16.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113322025-01-09T01:14:16.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113332025-01-09T01:14:16.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113342025-01-09T01:14:16.911ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.696589ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113352025-01-09T01:14:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113362025-01-09T01:14:16.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113372025-01-09T01:14:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113382025-01-09T01:14:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
113392025-01-09T01:14:16.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113402025-01-09T01:14:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113412025-01-09T01:14:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113422025-01-09T01:14:16.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113432025-01-09T01:14:16.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113442025-01-09T01:14:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113452025-01-09T01:14:16.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.854615ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
113462025-01-09T01:14:16.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113472025-01-09T01:14:16.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113482025-01-09T01:14:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113492025-01-09T01:14:16.916ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113502025-01-09T01:14:16.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113512025-01-09T01:14:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113522025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113532025-01-09T01:14:16.919ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113542025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
113552025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113562025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
113572025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113582025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113592025-01-09T01:14:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113602025-01-09T01:14:16.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113612025-01-09T01:14:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113622025-01-09T01:14:16.922ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1700, tv_nsec: 381103292 } })
113632025-01-09T01:14:16.922ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
113642025-01-09T01:14:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113652025-01-09T01:14:16.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113662025-01-09T01:14:16.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113672025-01-09T01:14:16.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113682025-01-09T01:14:16.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113692025-01-09T01:14:16.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.418251ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113702025-01-09T01:14:16.927ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113712025-01-09T01:14:16.927ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113722025-01-09T01:14:16.927ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113732025-01-09T01:14:16.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113742025-01-09T01:14:16.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113752025-01-09T01:14:16.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113762025-01-09T01:14:16.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113772025-01-09T01:14:16.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113782025-01-09T01:14:16.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113792025-01-09T01:14:16.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113802025-01-09T01:14:16.930ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113812025-01-09T01:14:16.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.336892ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113822025-01-09T01:14:16.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
113832025-01-09T01:14:16.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113842025-01-09T01:14:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113852025-01-09T01:14:16.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113862025-01-09T01:14:16.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113872025-01-09T01:14:16.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113882025-01-09T01:14:16.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113892025-01-09T01:14:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113902025-01-09T01:14:16.940ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
113912025-01-09T01:14:16.940ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.984789ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
113922025-01-09T01:14:16.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113932025-01-09T01:14:16.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113942025-01-09T01:14:16.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113952025-01-09T01:14:16.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113962025-01-09T01:14:16.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113972025-01-09T01:14:16.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113982025-01-09T01:14:16.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113992025-01-09T01:14:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114002025-01-09T01:14:16.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114012025-01-09T01:14:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114022025-01-09T01:14:16.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114032025-01-09T01:14:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114042025-01-09T01:14:16.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114052025-01-09T01:14:16.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114062025-01-09T01:14:16.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114072025-01-09T01:14:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114082025-01-09T01:14:16.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114092025-01-09T01:14:16.973ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114102025-01-09T01:14:16.973ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
114112025-01-09T01:14:16.973ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 72.063586ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
114122025-01-09T01:14:16.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114132025-01-09T01:14:16.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114142025-01-09T01:14:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114152025-01-09T01:14:16.986ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114162025-01-09T01:14:16.986ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114172025-01-09T01:14:16.986ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b440cafc-23a5-4404-a56b-fd9e5a13bf57", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114182025-01-09T01:14:16.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114192025-01-09T01:14:16.986ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114202025-01-09T01:14:16.986ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114212025-01-09T01:14:16.987ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ced3dcb-5442-40c3-8836-1720435c8bd5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114222025-01-09T01:14:16.987ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114232025-01-09T01:14:16.988ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114242025-01-09T01:14:16.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114252025-01-09T01:14:16.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.917556ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114262025-01-09T01:14:17.035ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 133.594054ms iteration = 25 status = {"physical_disks_added":0}
114272025-01-09T01:14:17.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 95be1d01-58a0-41c0-b2f6-af9875353209 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
114282025-01-09T01:14:17.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 95be1d01-58a0-41c0-b2f6-af9875353209 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
114292025-01-09T01:14:17.114ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
114302025-01-09T01:14:17.114ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc02f47-f2bc-47da-8d30-a6ae9b3fd15a", "content-length": "2", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114312025-01-09T01:14:17.116ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.25372ms iteration = 22 status = {}
114322025-01-09T01:14:17.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
114332025-01-09T01:14:17.116ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114342025-01-09T01:14:17.116ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c5c808b-9196-43f5-92cb-87d3f9b153f2", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114352025-01-09T01:14:17.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114362025-01-09T01:14:17.117ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114372025-01-09T01:14:17.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114382025-01-09T01:14:17.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
114392025-01-09T01:14:17.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114402025-01-09T01:14:17.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d16a2776-5aec-4b2e-9319-e759c6982674", "content-length": "810", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114412025-01-09T01:14:17.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(4929565) }} sled = buskin
114422025-01-09T01:14:17.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
114432025-01-09T01:14:17.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
114442025-01-09T01:14:17.138ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 237.085619ms iteration = 22 status = {}
114452025-01-09T01:14:17.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114462025-01-09T01:14:17.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114472025-01-09T01:14:17.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 95be1d01-58a0-41c0-b2f6-af9875353209 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
114482025-01-09T01:14:17.141ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.771812ms iteration = 22 status = null
114492025-01-09T01:14:17.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114502025-01-09T01:14:17.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
114512025-01-09T01:14:17.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114522025-01-09T01:14:17.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114532025-01-09T01:14:17.146ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 245.54082ms iteration = 22 status = 0
114542025-01-09T01:14:17.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 269.088762ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114552025-01-09T01:14:17.176ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114562025-01-09T01:14:17.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114572025-01-09T01:14:17.181ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114582025-01-09T01:14:17.181ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114592025-01-09T01:14:17.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1f29afb-1f53-4d6b-8ecf-0df20e4b04a7", "content-length": "372", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114602025-01-09T01:14:17.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114612025-01-09T01:14:17.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114622025-01-09T01:14:17.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 304.848728ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
114632025-01-09T01:14:17.230ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {3f150d20-bde0-4a89-bf9c-3cc8293a508d: {10.151.1.175: {205cb22a-cb2b-4dd5-b8ed-92ee79f9f372}, 10.151.1.176: {205cb22a-cb2b-4dd5-b8ed-92ee79f9f372}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
114642025-01-09T01:14:17.230ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114652025-01-09T01:14:17.230ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "57c7ded4-7225-47bf-8a78-3290ee99003d", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114662025-01-09T01:14:17.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114672025-01-09T01:14:17.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114682025-01-09T01:14:17.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114692025-01-09T01:14:17.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114702025-01-09T01:14:17.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114712025-01-09T01:14:17.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114722025-01-09T01:14:17.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114732025-01-09T01:14:17.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114742025-01-09T01:14:17.237ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
114752025-01-09T01:14:17.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114762025-01-09T01:14:17.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114772025-01-09T01:14:17.239ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114782025-01-09T01:14:17.239ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114792025-01-09T01:14:17.240ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "564e3b16-8590-47e9-bdf9-f001db68a96a", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
114802025-01-09T01:14:17.241ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 340.115533ms iteration = 22 status = {}
114812025-01-09T01:14:17.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
114822025-01-09T01:14:17.246ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a34cfa-586d-48be-a697-1aa84d6193df", "content-length": "134", "date": "Thu, 09 Jan 2025 01:14:17 GMT"} })
114832025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
114842025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
114852025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
114862025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
114872025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114882025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114892025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114902025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114912025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114922025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114932025-01-09T01:14:17.246ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
114942025-01-09T01:14:17.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114952025-01-09T01:14:17.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114962025-01-09T01:14:17.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
114972025-01-09T01:14:17.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca0b2ea-3a6c-4b23-9b0a-ca55f8f06a49", "content-length": "2", "date": "Thu, 09 Jan 2025 01:14:17 GMT"} })
114982025-01-09T01:14:17.249ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
114992025-01-09T01:14:17.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b503f6f-b128-4575-9128-6a5da3be5042", "content-length": "52", "date": "Thu, 09 Jan 2025 01:14:17 GMT"} })
115002025-01-09T01:14:17.249ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
115012025-01-09T01:14:17.249ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115022025-01-09T01:14:17.351ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3c52849c-4fd3-46a3-99f3-cc23c03aeb97", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
115032025-01-09T01:14:17.351ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
115042025-01-09T01:14:17.351ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115052025-01-09T01:14:17.352ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb61d942-44a9-481a-baf6-51cd9d06c6a1", "content-length": "682", "date": "Thu, 09 Jan 2025 01:14:16 GMT"} })
115062025-01-09T01:14:17.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115072025-01-09T01:14:17.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115082025-01-09T01:14:17.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115092025-01-09T01:14:17.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115102025-01-09T01:14:17.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115112025-01-09T01:14:17.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115122025-01-09T01:14:17.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115132025-01-09T01:14:17.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115142025-01-09T01:14:17.368ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.266322ms iteration = 22 status = {}
115152025-01-09T01:14:18.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c221d8fa-f477-42f2-bb4f-66071182a832 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115162025-01-09T01:14:18.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c221d8fa-f477-42f2-bb4f-66071182a832 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115172025-01-09T01:14:18.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c221d8fa-f477-42f2-bb4f-66071182a832 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115182025-01-09T01:14:19.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d126af52-67e9-4d15-bb7b-f16689f255ff roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115192025-01-09T01:14:19.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d126af52-67e9-4d15-bb7b-f16689f255ff resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115202025-01-09T01:14:19.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d126af52-67e9-4d15-bb7b-f16689f255ff response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115212025-01-09T01:14:19.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 1f8b9cf2-808a-49d8-91a8-8f6cfd443013 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
115222025-01-09T01:14:20.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 280ed66d-8162-4ed0-8c03-3c6a1f8d782a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115232025-01-09T01:14:20.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 280ed66d-8162-4ed0-8c03-3c6a1f8d782a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115242025-01-09T01:14:20.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 280ed66d-8162-4ed0-8c03-3c6a1f8d782a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115252025-01-09T01:14:21.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a61401e2-62dd-41a0-9e17-cf66764a896c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115262025-01-09T01:14:21.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a61401e2-62dd-41a0-9e17-cf66764a896c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115272025-01-09T01:14:21.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a61401e2-62dd-41a0-9e17-cf66764a896c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115282025-01-09T01:14:22.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4d6b7d6b-1009-49df-965e-85b0ee285e49 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115292025-01-09T01:14:22.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4d6b7d6b-1009-49df-965e-85b0ee285e49 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115302025-01-09T01:14:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4d6b7d6b-1009-49df-965e-85b0ee285e49 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115312025-01-09T01:14:23.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5206f6ea-59b4-4373-ab05-37a31b74c41a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115322025-01-09T01:14:23.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5206f6ea-59b4-4373-ab05-37a31b74c41a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115332025-01-09T01:14:23.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5206f6ea-59b4-4373-ab05-37a31b74c41a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115342025-01-09T01:14:24.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf545d08-f112-483e-b678-00728fde9db0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115352025-01-09T01:14:24.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf545d08-f112-483e-b678-00728fde9db0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115362025-01-09T01:14:24.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bf545d08-f112-483e-b678-00728fde9db0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115372025-01-09T01:14:25.068ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5239f250-4682-40aa-83fb-161d72fbab01 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-09T01:14:25.056579234Z }
115382025-01-09T01:14:25.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5239f250-4682-40aa-83fb-161d72fbab01 roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115392025-01-09T01:14:25.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5239f250-4682-40aa-83fb-161d72fbab01 resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115402025-01-09T01:14:25.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60156 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5239f250-4682-40aa-83fb-161d72fbab01 response_code = 204 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115412025-01-09T01:14:25.117ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ddcff25-995b-4181-9371-c39e6979dcf6 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T01:14:25.117275143Z }
115422025-01-09T01:14:25.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ddcff25-995b-4181-9371-c39e6979dcf6 roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115432025-01-09T01:14:25.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ddcff25-995b-4181-9371-c39e6979dcf6 resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115442025-01-09T01:14:25.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35859 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2ddcff25-995b-4181-9371-c39e6979dcf6 response_code = 204 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115452025-01-09T01:14:25.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 53fe5c41-25f7-4872-84eb-ff6a41742674 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115462025-01-09T01:14:25.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 53fe5c41-25f7-4872-84eb-ff6a41742674 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115472025-01-09T01:14:25.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 53fe5c41-25f7-4872-84eb-ff6a41742674 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115482025-01-09T01:14:26.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 025dae5b-11d9-4a69-9de5-e31a0508e5ad roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115492025-01-09T01:14:26.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 025dae5b-11d9-4a69-9de5-e31a0508e5ad resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115502025-01-09T01:14:26.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 025dae5b-11d9-4a69-9de5-e31a0508e5ad response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115512025-01-09T01:14:26.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
115522025-01-09T01:14:26.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
115532025-01-09T01:14:26.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115542025-01-09T01:14:26.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115552025-01-09T01:14:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115562025-01-09T01:14:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115572025-01-09T01:14:26.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115582025-01-09T01:14:26.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115592025-01-09T01:14:26.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115602025-01-09T01:14:26.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.699173ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115612025-01-09T01:14:26.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115622025-01-09T01:14:26.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115632025-01-09T01:14:26.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115642025-01-09T01:14:26.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115652025-01-09T01:14:26.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115662025-01-09T01:14:26.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115672025-01-09T01:14:26.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
115682025-01-09T01:14:26.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115692025-01-09T01:14:26.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115702025-01-09T01:14:26.951ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
115712025-01-09T01:14:26.951ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.286032ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
115722025-01-09T01:14:27.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 92fd3458-9010-4af6-8218-76171e9cfe8a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115732025-01-09T01:14:27.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 92fd3458-9010-4af6-8218-76171e9cfe8a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115742025-01-09T01:14:27.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 92fd3458-9010-4af6-8218-76171e9cfe8a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115752025-01-09T01:14:28.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2489aaff-7b4c-4c1a-8a9b-af270bfdcd75 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115762025-01-09T01:14:28.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2489aaff-7b4c-4c1a-8a9b-af270bfdcd75 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115772025-01-09T01:14:28.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2489aaff-7b4c-4c1a-8a9b-af270bfdcd75 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115782025-01-09T01:14:29.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 88839115-3080-47d3-93b8-6a9854b238e6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115792025-01-09T01:14:29.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 88839115-3080-47d3-93b8-6a9854b238e6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115802025-01-09T01:14:29.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 88839115-3080-47d3-93b8-6a9854b238e6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115812025-01-09T01:14:29.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 494 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = ba2704ac-513d-48ee-8f22-e0f1e1a3bf3b response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
115822025-01-09T01:14:30.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 030621d5-9949-4880-bb7d-24d0501c7f2b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115832025-01-09T01:14:30.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 030621d5-9949-4880-bb7d-24d0501c7f2b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115842025-01-09T01:14:30.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 030621d5-9949-4880-bb7d-24d0501c7f2b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115852025-01-09T01:14:31.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2bf98c65-ff1a-427d-b9a3-c0a839fcd208 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115862025-01-09T01:14:31.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2bf98c65-ff1a-427d-b9a3-c0a839fcd208 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115872025-01-09T01:14:31.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2bf98c65-ff1a-427d-b9a3-c0a839fcd208 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115882025-01-09T01:14:32.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4e743ed5-7d62-4fce-97fc-305a037a9189 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115892025-01-09T01:14:32.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4e743ed5-7d62-4fce-97fc-305a037a9189 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115902025-01-09T01:14:32.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4e743ed5-7d62-4fce-97fc-305a037a9189 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115912025-01-09T01:14:33.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 645fb200-4e48-45e7-a757-72f44412ba41 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115922025-01-09T01:14:33.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 645fb200-4e48-45e7-a757-72f44412ba41 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115932025-01-09T01:14:33.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 645fb200-4e48-45e7-a757-72f44412ba41 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115942025-01-09T01:14:34.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b39ebac-b769-4747-ad2e-c9fb17d4579b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115952025-01-09T01:14:34.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b39ebac-b769-4747-ad2e-c9fb17d4579b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115962025-01-09T01:14:34.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b39ebac-b769-4747-ad2e-c9fb17d4579b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
115972025-01-09T01:14:35.046ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85382d7a-0545-49f2-81aa-5263d83bce88 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-09T01:14:35.046388069Z }
115982025-01-09T01:14:35.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85382d7a-0545-49f2-81aa-5263d83bce88 roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
115992025-01-09T01:14:35.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85382d7a-0545-49f2-81aa-5263d83bce88 resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116002025-01-09T01:14:35.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44582 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 85382d7a-0545-49f2-81aa-5263d83bce88 response_code = 204 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116012025-01-09T01:14:35.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f99c4572-5939-4146-bd91-ce6df8286ab8 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
116022025-01-09T01:14:35.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f99c4572-5939-4146-bd91-ce6df8286ab8 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
116032025-01-09T01:14:35.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f99c4572-5939-4146-bd91-ce6df8286ab8 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
116042025-01-09T01:14:36.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b36d61f-0646-4752-8c13-9982a6443beb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
116052025-01-09T01:14:36.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b36d61f-0646-4752-8c13-9982a6443beb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
116062025-01-09T01:14:36.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6b36d61f-0646-4752-8c13-9982a6443beb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
116072025-01-09T01:14:36.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
116082025-01-09T01:14:36.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116092025-01-09T01:14:36.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
116102025-01-09T01:14:36.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116112025-01-09T01:14:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116122025-01-09T01:14:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116132025-01-09T01:14:36.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116142025-01-09T01:14:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116152025-01-09T01:14:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116162025-01-09T01:14:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116172025-01-09T01:14:36.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116182025-01-09T01:14:36.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116192025-01-09T01:14:36.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116202025-01-09T01:14:36.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
116212025-01-09T01:14:36.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116222025-01-09T01:14:36.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116232025-01-09T01:14:36.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
116242025-01-09T01:14:36.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.022415ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
116252025-01-09T01:14:36.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116262025-01-09T01:14:36.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116272025-01-09T01:14:36.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.503308ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116282025-01-09T01:14:37.534ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:14:37.533784049Z }
116292025-01-09T01:14:37.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116302025-01-09T01:14:37.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116312025-01-09T01:14:37.570ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_needs_update = true
116322025-01-09T01:14:37.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116332025-01-09T01:14:37.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116342025-01-09T01:14:37.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116352025-01-09T01:14:37.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116362025-01-09T01:14:37.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116372025-01-09T01:14:37.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116382025-01-09T01:14:37.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116392025-01-09T01:14:37.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116402025-01-09T01:14:37.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116412025-01-09T01:14:37.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116422025-01-09T01:14:37.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116432025-01-09T01:14:37.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116442025-01-09T01:14:37.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116452025-01-09T01:14:37.613ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 795528e9-4767-49c0-875c-03687d636f7a, lookup_type: ById(795528e9-4767-49c0-875c-03687d636f7a) }, key: 0918b7c8-92fc-42db-bc18-6b29244686c9, lookup_type: ById(0918b7c8-92fc-42db-bc18-6b29244686c9) }, key: d2d2bb3c-2257-4f1d-9c60-defe7d956daa, lookup_type: ById(d2d2bb3c-2257-4f1d-9c60-defe7d956daa) } result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116462025-01-09T01:14:37.621ZINFOnexus (dropshot_internal): starting update saga for d2d2bb3c-2257-4f1d-9c60-defe7d956daa actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:14:37.533784049Z }
116472025-01-09T01:14:37.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87521 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f response_code = 204 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116482025-01-09T01:14:37.621ZDEBGnexus (dropshot_internal): preparing instance-update saga for d2d2bb3c-2257-4f1d-9c60-defe7d956daa... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f17d9c54-9a17-4d79-90bf-30a9572eb10f uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116492025-01-09T01:14:37.621ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update
116502025-01-09T01:14:37.622ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c539d63c-9e0e-4109-b1a6-290bb8ed5777 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:14:37.533784049Z }
116512025-01-09T01:14:37.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c539d63c-9e0e-4109-b1a6-290bb8ed5777 roles = RoleSet { roles: {} } uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116522025-01-09T01:14:37.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c539d63c-9e0e-4109-b1a6-290bb8ed5777 resource = Database result = Ok(()) uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116532025-01-09T01:14:37.623ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d2d2bb3c-2257-4f1d-9c60-defe7d956daa","lookup_type":{"ById":"d2d2bb3c-2257-4f1d-9c60-defe7d956daa"},"parent":{"key":"0918b7c8-92fc-42db-bc18-6b29244686c9","lookup_type":{"ById":"0918b7c8-92fc-42db-bc18-6b29244686c9"},"parent":{"key":"795528e9-4767-49c0-875c-03687d636f7a","lookup_type":{"ById":"795528e9-4767-49c0-875c-03687d636f7a"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116542025-01-09T01:14:37.623ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update
116552025-01-09T01:14:37.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33728 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c539d63c-9e0e-4109-b1a6-290bb8ed5777 response_code = 204 uri = /vmms/cc75425d-2d9d-4046-87bc-6a23a79c7a17
116562025-01-09T01:14:37.664ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update
116572025-01-09T01:14:37.664ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116582025-01-09T01:14:37.664ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116592025-01-09T01:14:37.664ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116602025-01-09T01:14:37.671ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116612025-01-09T01:14:37.671ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116622025-01-09T01:14:37.674ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116632025-01-09T01:14:37.674ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116642025-01-09T01:14:37.684ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116652025-01-09T01:14:37.684ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("672dc0b5-6ae9-4bf3-b485-db487f5b47d5")) node_id = 0 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116662025-01-09T01:14:37.688ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116672025-01-09T01:14:37.688ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116682025-01-09T01:14:37.704ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update
116692025-01-09T01:14:37.709ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116702025-01-09T01:14:37.709ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116712025-01-09T01:14:37.711ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116722025-01-09T01:14:37.711ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116732025-01-09T01:14:37.713ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116742025-01-09T01:14:37.713ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116752025-01-09T01:14:37.714ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116762025-01-09T01:14:37.715ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116772025-01-09T01:14:37.716ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116782025-01-09T01:14:37.716ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116792025-01-09T01:14:37.717ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116802025-01-09T01:14:37.717ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116812025-01-09T01:14:37.719ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116822025-01-09T01:14:37.722ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 795528e9-4767-49c0-875c-03687d636f7a, lookup_type: ById(795528e9-4767-49c0-875c-03687d636f7a) }, key: 0918b7c8-92fc-42db-bc18-6b29244686c9, lookup_type: ById(0918b7c8-92fc-42db-bc18-6b29244686c9) }, key: d2d2bb3c-2257-4f1d-9c60-defe7d956daa, lookup_type: ById(d2d2bb3c-2257-4f1d-9c60-defe7d956daa) } result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116832025-01-09T01:14:37.725ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance updater_id = 672dc0b5-6ae9-4bf3-b485-db487f5b47d5
116842025-01-09T01:14:37.725ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116852025-01-09T01:14:37.725ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116862025-01-09T01:14:37.736ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance updater_id = 672dc0b5-6ae9-4bf3-b485-db487f5b47d5
116872025-01-09T01:14:37.736ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116882025-01-09T01:14:37.736ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance
116892025-01-09T01:14:37.743ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa locked_gen = Generation(Generation(2)) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = LockInstance updater_id = 672dc0b5-6ae9-4bf3-b485-db487f5b47d5
116902025-01-09T01:14:37.750ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116912025-01-09T01:14:37.750ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("672dc0b5-6ae9-4bf3-b485-db487f5b47d5")}) node_id = 1 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116922025-01-09T01:14:37.754ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
116932025-01-09T01:14:37.754ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
116942025-01-09T01:14:37.761ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
116952025-01-09T01:14:37.762ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
116962025-01-09T01:14:37.763ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
116972025-01-09T01:14:37.763ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
116982025-01-09T01:14:37.764ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
116992025-01-09T01:14:37.764ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
117002025-01-09T01:14:37.766ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
117012025-01-09T01:14:37.769ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 795528e9-4767-49c0-875c-03687d636f7a, lookup_type: ById(795528e9-4767-49c0-875c-03687d636f7a) }, key: 0918b7c8-92fc-42db-bc18-6b29244686c9, lookup_type: ById(0918b7c8-92fc-42db-bc18-6b29244686c9) }, key: d2d2bb3c-2257-4f1d-9c60-defe7d956daa, lookup_type: ById(d2d2bb3c-2257-4f1d-9c60-defe7d956daa) } result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
117022025-01-09T01:14:37.769ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
117032025-01-09T01:14:37.769ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
117042025-01-09T01:14:37.777ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: cc75425d-2d9d-4046-87bc-6a23a79c7a17, time_created: 2025-01-09T01:14:16.302902Z, time_deleted: None, instance_id: d2d2bb3c-2257-4f1d-9c60-defe7d956daa, sled_id: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-09T01:14:37.533784Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-09T01:14:14.143518Z, gen: Generation(Generation(3)), propolis_id: Some(cc75425d-2d9d-4046-87bc-6a23a79c7a17), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(cc75425d-2d9d-4046-87bc-6a23a79c7a17 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-09T01:14:37.777198101Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
117052025-01-09T01:14:37.782ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117062025-01-09T01:14:37.782ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d2d2bb3c-2257-4f1d-9c60-defe7d956daa","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"cc75425d-2d9d-4046-87bc-6a23a79c7a17"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"d2d2bb3c-2257-4f1d-9c60-defe7d956daa","lookup_type":{"ById":"d2d2bb3c-2257-4f1d-9c60-defe7d956daa"},"parent":{"key":"0918b7c8-92fc-42db-bc18-6b29244686c9","lookup_type":{"ById":"0918b7c8-92fc-42db-bc18-6b29244686c9"},"parent":{"key":"795528e9-4767-49c0-875c-03687d636f7a","lookup_type":{"ById":"795528e9-4767-49c0-875c-03687d636f7a"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"672dc0b5-6ae9-4bf3-b485-db487f5b47d5"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"0918b7c8-92fc-42db-bc18-6b29244686c9","ram_diff":1073741824},"destroy_active_vmm":"cc75425d-2d9d-4046-87bc-6a23a79c7a17","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-09T01:14:37.777198101Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117072025-01-09T01:14:37.782ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117082025-01-09T01:14:37.785ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117092025-01-09T01:14:37.785ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117102025-01-09T01:14:37.785ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117112025-01-09T01:14:37.785ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117122025-01-09T01:14:37.788ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117132025-01-09T01:14:37.788ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117142025-01-09T01:14:37.791ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117152025-01-09T01:14:37.791ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117162025-01-09T01:14:37.794ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117172025-01-09T01:14:37.794ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5584634e-5abb-47c9-90f4-89eb243b777e")) node_id = 0 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117182025-01-09T01:14:37.797ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117192025-01-09T01:14:37.798ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117202025-01-09T01:14:37.808ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa parent_lock = UpdaterLock { updater_id: 672dc0b5-6ae9-4bf3-b485-db487f5b47d5, locked_gen: Generation(Generation(2)) } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117212025-01-09T01:14:37.808ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = BecomeUpdater
117222025-01-09T01:14:37.808ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = BecomeUpdater
117232025-01-09T01:14:37.819ZDEBGnexus (SagaExecutor): inherited lock from 672dc0b5-6ae9-4bf3-b485-db487f5b47d5 to 5584634e-5abb-47c9-90f4-89eb243b777e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 672dc0b5-6ae9-4bf3-b485-db487f5b47d5 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = BecomeUpdater updater_id = 5584634e-5abb-47c9-90f4-89eb243b777e
117242025-01-09T01:14:37.819ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117252025-01-09T01:14:37.819ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117262025-01-09T01:14:37.819ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5584634e-5abb-47c9-90f4-89eb243b777e")}) node_id = 1 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117272025-01-09T01:14:37.823ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117282025-01-09T01:14:37.823ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117292025-01-09T01:14:37.826ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117302025-01-09T01:14:37.826ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117312025-01-09T01:14:37.831ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117322025-01-09T01:14:37.831ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117332025-01-09T01:14:37.835ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117342025-01-09T01:14:37.835ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa
117352025-01-09T01:14:37.835ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UpdateNetworkConfig
117362025-01-09T01:14:37.835ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UpdateNetworkConfig
117372025-01-09T01:14:37.838ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UpdateNetworkConfig
117382025-01-09T01:14:37.839ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UpdateNetworkConfig
117392025-01-09T01:14:37.841ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
117402025-01-09T01:14:37.841ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UpdateNetworkConfig
117412025-01-09T01:14:37.841ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UpdateNetworkConfig
117422025-01-09T01:14:37.843ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
117432025-01-09T01:14:37.843ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
117442025-01-09T01:14:37.843ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
117452025-01-09T01:14:37.844ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
117462025-01-09T01:14:37.846ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
117472025-01-09T01:14:37.846ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
117482025-01-09T01:14:37.846ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
117492025-01-09T01:14:37.850ZDEBGnexus: notifying dendrite of updates instance_id = Some(d2d2bb3c-2257-4f1d-9c60-defe7d956daa (instance)) switch = switch0
117502025-01-09T01:14:37.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 310118957 } })
117512025-01-09T01:14:37.851ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
117522025-01-09T01:14:37.882ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
117532025-01-09T01:14:37.882ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117542025-01-09T01:14:37.882ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26759d4e-1f16-41dc-aa4d-4f8bc6f60800", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:37 GMT"} })
117552025-01-09T01:14:37.882ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117562025-01-09T01:14:37.883ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
117572025-01-09T01:14:37.912ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
117582025-01-09T01:14:37.913ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "174e34f7-adac-41ed-9a40-17596746baa5", "content-length": "4", "date": "Thu, 09 Jan 2025 01:14:37 GMT"} })
117592025-01-09T01:14:37.914ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117602025-01-09T01:14:37.914ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117612025-01-09T01:14:37.918ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117622025-01-09T01:14:37.918ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117632025-01-09T01:14:37.921ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
117642025-01-09T01:14:37.922ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
117652025-01-09T01:14:37.935ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-09T01:14:37.924666Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 0918b7c8-92fc-42db-bc18-6b29244686c9, time_modified: Some(2025-01-09T01:14:37.924666Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 795528e9-4767-49c0-875c-03687d636f7a, time_modified: Some(2025-01-09T01:14:37.924666Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117662025-01-09T01:14:37.935ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117672025-01-09T01:14:37.935ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117682025-01-09T01:14:37.940ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117692025-01-09T01:14:37.940ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117702025-01-09T01:14:37.943ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117712025-01-09T01:14:37.943ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UnassignOximeterProducer
117722025-01-09T01:14:37.943ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UnassignOximeterProducer
117732025-01-09T01:14:37.950ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 producer_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117742025-01-09T01:14:37.950ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UnassignOximeterProducer
117752025-01-09T01:14:37.950ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = UnassignOximeterProducer
117762025-01-09T01:14:37.985ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117772025-01-09T01:14:37.987ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/d2d2bb3c-2257-4f1d-9c60-defe7d956daa
117782025-01-09T01:14:38.009ZDEBGnexus (SagaExecutor): client response oximeter-collector = d2d2bb3c-2257-4f1d-9c60-defe7d956daa result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/d2d2bb3c-2257-4f1d-9c60-defe7d956daa", status: 204, headers: {"x-request-id": "f74b0424-72c8-42f9-b541-1a029558c5aa", "date": "Thu, 09 Jan 2025 01:14:37 GMT"} }) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117792025-01-09T01:14:38.009ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 producer_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117802025-01-09T01:14:38.010ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117812025-01-09T01:14:38.010ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117822025-01-09T01:14:38.013ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117832025-01-09T01:14:38.013ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117842025-01-09T01:14:38.019ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa lock = UpdaterLock { updater_id: 5584634e-5abb-47c9-90f4-89eb243b777e, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-09T01:14:37.777198101Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117852025-01-09T01:14:38.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = CommitInstanceUpdates
117862025-01-09T01:14:38.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = CommitInstanceUpdates
117872025-01-09T01:14:38.055ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa new_runtime = InstanceRuntimeState { time_updated: 2025-01-09T01:14:37.777198101Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
117882025-01-09T01:14:38.055ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117892025-01-09T01:14:38.056ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
117902025-01-09T01:14:38.056ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Signaled
117912025-01-09T01:14:38.056ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Signaled
117922025-01-09T01:14:38.056ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117932025-01-09T01:14:38.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117942025-01-09T01:14:38.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117952025-01-09T01:14:38.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117962025-01-09T01:14:38.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117972025-01-09T01:14:38.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117982025-01-09T01:14:38.059ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
117992025-01-09T01:14:38.059ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118002025-01-09T01:14:38.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118012025-01-09T01:14:38.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118022025-01-09T01:14:38.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118032025-01-09T01:14:38.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118042025-01-09T01:14:38.064ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118052025-01-09T01:14:38.064ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d2d2bb3c-2257-4f1d-9c60-defe7d956daa"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cc75425d-2d9d-4046-87bc-6a23a79c7a17")}) node_id = 7 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118062025-01-09T01:14:38.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118072025-01-09T01:14:38.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118082025-01-09T01:14:38.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118092025-01-09T01:14:38.072ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118102025-01-09T01:14:38.072ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118112025-01-09T01:14:38.075ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118122025-01-09T01:14:38.075ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118132025-01-09T01:14:38.079ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118142025-01-09T01:14:38.079ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118152025-01-09T01:14:38.085ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
118162025-01-09T01:14:38.086ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ReleaseSledResources
118172025-01-09T01:14:38.086ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ReleaseSledResources
118182025-01-09T01:14:38.098ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118192025-01-09T01:14:38.098ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118202025-01-09T01:14:38.099ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "422dc3a5-b972-4862-8305-aca9b29fd721", "content-length": "372", "date": "Thu, 09 Jan 2025 01:14:38 GMT"} })
118212025-01-09T01:14:38.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118222025-01-09T01:14:38.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118232025-01-09T01:14:38.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118242025-01-09T01:14:38.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118252025-01-09T01:14:38.103ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118262025-01-09T01:14:38.103ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118272025-01-09T01:14:38.113ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118282025-01-09T01:14:38.113ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118292025-01-09T01:14:38.117ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa propolis_id = cc75425d-2d9d-4046-87bc-6a23a79c7a17 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
118302025-01-09T01:14:38.117ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = MarkVmmDeleted
118312025-01-09T01:14:38.118ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = MarkVmmDeleted
118322025-01-09T01:14:38.119ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {3f150d20-bde0-4a89-bf9c-3cc8293a508d: {10.151.1.176: {205cb22a-cb2b-4dd5-b8ed-92ee79f9f372}, 10.151.1.175: {205cb22a-cb2b-4dd5-b8ed-92ee79f9f372}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118332025-01-09T01:14:38.119ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118342025-01-09T01:14:38.119ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fbf7c631-7298-4db5-8045-900302a89daf", "date": "Thu, 09 Jan 2025 01:14:38 GMT"} })
118352025-01-09T01:14:38.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118362025-01-09T01:14:38.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118372025-01-09T01:14:38.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118382025-01-09T01:14:38.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118392025-01-09T01:14:38.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118402025-01-09T01:14:38.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118412025-01-09T01:14:38.127ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118422025-01-09T01:14:38.127ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118432025-01-09T01:14:38.128ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118442025-01-09T01:14:38.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118452025-01-09T01:14:38.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "710aa22a-a41c-4d50-a54f-a615fee79655", "date": "Thu, 09 Jan 2025 01:14:38 GMT"} })
118462025-01-09T01:14:38.130ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 74.643415ms iteration = 23 status = {}
118472025-01-09T01:14:38.131ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118482025-01-09T01:14:38.131ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118492025-01-09T01:14:38.134ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118502025-01-09T01:14:38.134ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118512025-01-09T01:14:38.137ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118522025-01-09T01:14:38.137ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118532025-01-09T01:14:38.140ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118542025-01-09T01:14:38.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118552025-01-09T01:14:38.142ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118562025-01-09T01:14:38.142ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118572025-01-09T01:14:38.143ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118582025-01-09T01:14:38.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118592025-01-09T01:14:38.145ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118602025-01-09T01:14:38.148ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 795528e9-4767-49c0-875c-03687d636f7a, lookup_type: ById(795528e9-4767-49c0-875c-03687d636f7a) }, key: 0918b7c8-92fc-42db-bc18-6b29244686c9, lookup_type: ById(0918b7c8-92fc-42db-bc18-6b29244686c9) }, key: d2d2bb3c-2257-4f1d-9c60-defe7d956daa, lookup_type: ById(d2d2bb3c-2257-4f1d-9c60-defe7d956daa) } result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118612025-01-09T01:14:38.148ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118622025-01-09T01:14:38.148ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_node = ChainSuccessorSaga
118632025-01-09T01:14:38.153ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa karmic_state = WillReincarnate needs_reincarnation = false saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update
118642025-01-09T01:14:38.153ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118652025-01-09T01:14:38.153ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118662025-01-09T01:14:38.156ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118672025-01-09T01:14:38.156ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118682025-01-09T01:14:38.159ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118692025-01-09T01:14:38.159ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118702025-01-09T01:14:38.163ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118712025-01-09T01:14:38.163ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57
118722025-01-09T01:14:38.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118732025-01-09T01:14:38.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118742025-01-09T01:14:38.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118752025-01-09T01:14:38.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118762025-01-09T01:14:38.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118772025-01-09T01:14:38.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118782025-01-09T01:14:38.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118792025-01-09T01:14:38.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118802025-01-09T01:14:38.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118812025-01-09T01:14:38.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118822025-01-09T01:14:38.227ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118832025-01-09T01:14:38.227ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 saga_name = instance-update saga_result = SagaResult { saga_id: ce3ada52-4a13-4b13-afe5-8807e32abd57, saga_log: SagaLog { saga_id: ce3ada52-4a13-4b13-afe5-8807e32abd57, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("5584634e-5abb-47c9-90f4-89eb243b777e")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5584634e-5abb-47c9-90f4-89eb243b777e")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d2d2bb3c-2257-4f1d-9c60-defe7d956daa"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cc75425d-2d9d-4046-87bc-6a23a79c7a17")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d2d2bb3c-2257-4f1d-9c60-defe7d956daa"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cc75425d-2d9d-4046-87bc-6a23a79c7a17")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("5584634e-5abb-47c9-90f4-89eb243b777e"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("5584634e-5abb-47c9-90f4-89eb243b777e")}} }) }
118842025-01-09T01:14:38.227ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = ce3ada52-4a13-4b13-afe5-8807e32abd57 instance_id = d2d2bb3c-2257-4f1d-9c60-defe7d956daa saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update
118852025-01-09T01:14:38.227ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118862025-01-09T01:14:38.227ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
118872025-01-09T01:14:38.231ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118882025-01-09T01:14:38.231ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
118892025-01-09T01:14:38.235ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118902025-01-09T01:14:38.235ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
118912025-01-09T01:14:38.238ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118922025-01-09T01:14:38.238ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c
118932025-01-09T01:14:38.271ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update sec_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
118942025-01-09T01:14:38.271ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c saga_name = start-instance-update saga_result = SagaResult { saga_id: 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c, saga_log: SagaLog { saga_id: 6a18f732-9a04-4bf3-b6de-ce4fe2ed1b9c, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("672dc0b5-6ae9-4bf3-b485-db487f5b47d5")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("672dc0b5-6ae9-4bf3-b485-db487f5b47d5")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("672dc0b5-6ae9-4bf3-b485-db487f5b47d5"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("672dc0b5-6ae9-4bf3-b485-db487f5b47d5")}} }) }
118952025-01-09T01:14:38.305ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118962025-01-09T01:14:38.306ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ada4060a-65e8-463c-a1f3-f0bf9b4338c4", "content-length": "691", "date": "Thu, 09 Jan 2025 01:14:38 GMT"} })
118972025-01-09T01:14:38.306ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
118982025-01-09T01:14:38.306ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
118992025-01-09T01:14:38.306ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119002025-01-09T01:14:38.307ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 251.318381ms iteration = 23 status = {}
119012025-01-09T01:14:38.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcc6685b-ea4e-4fbb-b843-467fbf4bb8aa roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119022025-01-09T01:14:38.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcc6685b-ea4e-4fbb-b843-467fbf4bb8aa resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119032025-01-09T01:14:38.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcc6685b-ea4e-4fbb-b843-467fbf4bb8aa response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119042025-01-09T01:14:39.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4df2b596-ec3b-440e-8fe8-a1787c5dbb0f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119052025-01-09T01:14:39.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4df2b596-ec3b-440e-8fe8-a1787c5dbb0f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119062025-01-09T01:14:39.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4df2b596-ec3b-440e-8fe8-a1787c5dbb0f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119072025-01-09T01:14:39.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 6f815a08-048d-418e-ad9c-709a521b14ff response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
119082025-01-09T01:14:40.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9f55a8b9-30f3-4071-8c94-80359a2cb63c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119092025-01-09T01:14:40.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9f55a8b9-30f3-4071-8c94-80359a2cb63c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119102025-01-09T01:14:40.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9f55a8b9-30f3-4071-8c94-80359a2cb63c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119112025-01-09T01:14:41.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e75d66ef-2082-47c5-9d00-9f572b72bdfb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119122025-01-09T01:14:41.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e75d66ef-2082-47c5-9d00-9f572b72bdfb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119132025-01-09T01:14:41.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e75d66ef-2082-47c5-9d00-9f572b72bdfb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119142025-01-09T01:14:42.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35df89dd-d25b-4a9d-9935-ad331122957c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119152025-01-09T01:14:42.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35df89dd-d25b-4a9d-9935-ad331122957c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119162025-01-09T01:14:42.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35df89dd-d25b-4a9d-9935-ad331122957c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119172025-01-09T01:14:43.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 75195aba-bfa2-4289-a784-5fcf8be48d1d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119182025-01-09T01:14:43.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 75195aba-bfa2-4289-a784-5fcf8be48d1d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119192025-01-09T01:14:43.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 75195aba-bfa2-4289-a784-5fcf8be48d1d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119202025-01-09T01:14:44.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c712e2b3-1c67-403e-8521-19b2b73fd15e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119212025-01-09T01:14:44.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c712e2b3-1c67-403e-8521-19b2b73fd15e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119222025-01-09T01:14:44.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c712e2b3-1c67-403e-8521-19b2b73fd15e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119232025-01-09T01:14:45.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3500bec0-5a8e-4369-9d65-70d577b5a4af roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119242025-01-09T01:14:45.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3500bec0-5a8e-4369-9d65-70d577b5a4af resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119252025-01-09T01:14:45.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3500bec0-5a8e-4369-9d65-70d577b5a4af response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119262025-01-09T01:14:46.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9f19530-0e36-4fd7-a72f-3d91c5888e2c roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119272025-01-09T01:14:46.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9f19530-0e36-4fd7-a72f-3d91c5888e2c resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119282025-01-09T01:14:46.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f9f19530-0e36-4fd7-a72f-3d91c5888e2c response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
119292025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
119302025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
119312025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
119322025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119332025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
119342025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
119352025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119362025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
119372025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
119382025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119392025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
119402025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119412025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
119422025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
119432025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
119442025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119452025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
119462025-01-09T01:14:46.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:04:46.901340096 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
119472025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
119482025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
119492025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
119502025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
119512025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119522025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
119532025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
119542025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119552025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
119562025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
119572025-01-09T01:14:46.901ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
119582025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
119592025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
119602025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119612025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
119622025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
119632025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119642025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
119652025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
119662025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119672025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
119682025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
119692025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
119702025-01-09T01:14:46.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
119712025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
119722025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
119732025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.84\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
119742025-01-09T01:14:46.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
119752025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
119762025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119772025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
119782025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
119792025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
119802025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119812025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
119822025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
119832025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119842025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119852025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
119862025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119872025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
119882025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119892025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
119902025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119912025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
119922025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119932025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
119942025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
119952025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119962025-01-09T01:14:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1730, tv_nsec: 360660783 } })
119972025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119982025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119992025-01-09T01:14:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120002025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120012025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120022025-01-09T01:14:46.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1730, tv_nsec: 360783505 } })
120032025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120042025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120052025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
120062025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
120072025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120082025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120092025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120102025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120112025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
120122025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120132025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120142025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120152025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120162025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120172025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
120182025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.33807ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
120192025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
120202025-01-09T01:14:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.377721ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
120212025-01-09T01:14:46.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120222025-01-09T01:14:46.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1730, tv_nsec: 363886115 } })
120232025-01-09T01:14:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.812366ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
120242025-01-09T01:14:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.00413ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
120252025-01-09T01:14:46.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
120262025-01-09T01:14:46.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:04:46.901340096 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
120272025-01-09T01:14:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.458601ms iteration = 12 status = {"expiration":"2025-01-09T01:04:46.901340096Z","pruned":[]}
120282025-01-09T01:14:46.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
120292025-01-09T01:14:46.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120302025-01-09T01:14:46.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120312025-01-09T01:14:46.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120322025-01-09T01:14:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120332025-01-09T01:14:46.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120342025-01-09T01:14:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120352025-01-09T01:14:46.908ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1730, tv_nsec: 367623720 } })
120362025-01-09T01:14:46.909ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
120372025-01-09T01:14:46.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120382025-01-09T01:14:46.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120392025-01-09T01:14:46.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120402025-01-09T01:14:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
120412025-01-09T01:14:46.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120422025-01-09T01:14:46.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120432025-01-09T01:14:46.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120442025-01-09T01:14:46.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120452025-01-09T01:14:46.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120462025-01-09T01:14:46.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120472025-01-09T01:14:46.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120482025-01-09T01:14:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120492025-01-09T01:14:46.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120502025-01-09T01:14:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120512025-01-09T01:14:46.953ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120522025-01-09T01:14:46.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
120532025-01-09T01:14:46.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120542025-01-09T01:14:46.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120552025-01-09T01:14:46.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.005489ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
120562025-01-09T01:14:46.964ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
120572025-01-09T01:14:46.964ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
120582025-01-09T01:14:46.964ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.52635ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
120592025-01-09T01:14:46.968ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120602025-01-09T01:14:46.968ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
120612025-01-09T01:14:46.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120622025-01-09T01:14:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120632025-01-09T01:14:46.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120642025-01-09T01:14:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120652025-01-09T01:14:46.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120662025-01-09T01:14:46.971ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120672025-01-09T01:14:46.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120682025-01-09T01:14:46.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120692025-01-09T01:14:46.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
120702025-01-09T01:14:46.975ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
120712025-01-09T01:14:46.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120722025-01-09T01:14:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
120732025-01-09T01:14:46.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120742025-01-09T01:14:46.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120752025-01-09T01:14:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120762025-01-09T01:14:46.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120772025-01-09T01:14:46.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120782025-01-09T01:14:46.977ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
120792025-01-09T01:14:46.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.847951ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
120802025-01-09T01:14:46.980ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120812025-01-09T01:14:46.980ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
120822025-01-09T01:14:46.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120832025-01-09T01:14:46.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.092235ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
120842025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120852025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120862025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120872025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120882025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
120892025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
120902025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120912025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
120922025-01-09T01:14:46.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120932025-01-09T01:14:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120942025-01-09T01:14:46.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120952025-01-09T01:14:46.983ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120962025-01-09T01:14:46.984ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120972025-01-09T01:14:46.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120982025-01-09T01:14:46.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
120992025-01-09T01:14:46.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121002025-01-09T01:14:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121012025-01-09T01:14:46.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121022025-01-09T01:14:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121032025-01-09T01:14:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121042025-01-09T01:14:46.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.711799ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
121052025-01-09T01:14:46.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121062025-01-09T01:14:46.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121072025-01-09T01:14:46.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1730, tv_nsec: 449535808 } })
121082025-01-09T01:14:46.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.661723ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121092025-01-09T01:14:46.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121102025-01-09T01:14:46.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
121112025-01-09T01:14:46.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121122025-01-09T01:14:46.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121132025-01-09T01:14:46.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121142025-01-09T01:14:46.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121152025-01-09T01:14:46.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
121162025-01-09T01:14:46.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121172025-01-09T01:14:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121182025-01-09T01:14:47.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121192025-01-09T01:14:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121202025-01-09T01:14:47.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121212025-01-09T01:14:47.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121222025-01-09T01:14:47.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121232025-01-09T01:14:47.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121242025-01-09T01:14:47.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121252025-01-09T01:14:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
121262025-01-09T01:14:47.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121272025-01-09T01:14:47.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121282025-01-09T01:14:47.016ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
121292025-01-09T01:14:47.016ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.728729ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
121302025-01-09T01:14:47.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121312025-01-09T01:14:47.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121322025-01-09T01:14:47.018ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.667482ms iteration = 23 status = 0
121332025-01-09T01:14:47.024ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
121342025-01-09T01:14:47.024ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
121352025-01-09T01:14:47.024ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
121362025-01-09T01:14:47.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121372025-01-09T01:14:47.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121382025-01-09T01:14:47.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121392025-01-09T01:14:47.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121402025-01-09T01:14:47.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121412025-01-09T01:14:47.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
121422025-01-09T01:14:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121432025-01-09T01:14:47.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121442025-01-09T01:14:47.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121452025-01-09T01:14:47.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.763698ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
121462025-01-09T01:14:47.033ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
121472025-01-09T01:14:47.033ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
121482025-01-09T01:14:47.033ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 131.904757ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
121492025-01-09T01:14:47.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121502025-01-09T01:14:47.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121512025-01-09T01:14:47.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121522025-01-09T01:14:47.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121532025-01-09T01:14:47.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121542025-01-09T01:14:47.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121552025-01-09T01:14:47.047ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121562025-01-09T01:14:47.047ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
121572025-01-09T01:14:47.047ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.404373ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
121582025-01-09T01:14:47.049ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
121592025-01-09T01:14:47.049ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
121602025-01-09T01:14:47.049ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
121612025-01-09T01:14:47.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121622025-01-09T01:14:47.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121632025-01-09T01:14:47.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121642025-01-09T01:14:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121652025-01-09T01:14:47.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121662025-01-09T01:14:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121672025-01-09T01:14:47.057ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
121682025-01-09T01:14:47.057ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
121692025-01-09T01:14:47.057ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e1d87b5-6d5d-4df0-b21b-c6d43d41db7e", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} })
121702025-01-09T01:14:47.057ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
121712025-01-09T01:14:47.059ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
121722025-01-09T01:14:47.065ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
121732025-01-09T01:14:47.065ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
121742025-01-09T01:14:47.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121752025-01-09T01:14:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121762025-01-09T01:14:47.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.074992ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
121772025-01-09T01:14:47.083ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
121782025-01-09T01:14:47.084ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.789394ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
121792025-01-09T01:14:47.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121802025-01-09T01:14:47.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121812025-01-09T01:14:47.097ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
121822025-01-09T01:14:47.097ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
121832025-01-09T01:14:47.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121842025-01-09T01:14:47.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121852025-01-09T01:14:47.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121862025-01-09T01:14:47.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121872025-01-09T01:14:47.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121882025-01-09T01:14:47.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121892025-01-09T01:14:47.108ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
121902025-01-09T01:14:47.108ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
121912025-01-09T01:14:47.108ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
121922025-01-09T01:14:47.108ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 206.874777ms iteration = 12 status = {"generation":1}
121932025-01-09T01:14:47.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121942025-01-09T01:14:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121952025-01-09T01:14:47.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121962025-01-09T01:14:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121972025-01-09T01:14:47.125ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 224.208409ms iteration = 26 status = {"physical_disks_added":0}
121982025-01-09T01:14:47.130ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
121992025-01-09T01:14:47.130ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 229.13971ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
122002025-01-09T01:14:47.166ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
122012025-01-09T01:14:47.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
122022025-01-09T01:14:47.171ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122032025-01-09T01:14:47.171ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81c90223-faf1-4b03-80b9-8866076cf242", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} })
122042025-01-09T01:14:47.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122052025-01-09T01:14:47.174ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
122062025-01-09T01:14:47.176ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
122072025-01-09T01:14:47.176ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122082025-01-09T01:14:47.176ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc73f628-9c55-475c-970c-63fadc46d0e2", "content-length": "26", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} })
122092025-01-09T01:14:47.176ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122102025-01-09T01:14:47.178ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122112025-01-09T01:14:47.185ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
122122025-01-09T01:14:47.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3453f9ef-dda9-4afa-b140-8c1f997611ae", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122132025-01-09T01:14:47.185ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122142025-01-09T01:14:47.187ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cdf304f0-24ed-4828-b6d4-c80b74e543a6", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122152025-01-09T01:14:47.187ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122162025-01-09T01:14:47.189ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122172025-01-09T01:14:47.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 288.638233ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
122182025-01-09T01:14:47.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122192025-01-09T01:14:47.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122202025-01-09T01:14:47.233ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 331.869237ms iteration = 23 status = {}
122212025-01-09T01:14:47.309ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122222025-01-09T01:14:47.309ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e71008e-9d9f-4e6c-a210-62643739b37f", "content-length": "2", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
122232025-01-09T01:14:47.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
122242025-01-09T01:14:47.311ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122252025-01-09T01:14:47.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122262025-01-09T01:14:47.321ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122272025-01-09T01:14:47.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122282025-01-09T01:14:47.321ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9124c41c-101e-45fc-9902-6d21240d3d5c", "content-length": "372", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} })
122292025-01-09T01:14:47.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122302025-01-09T01:14:47.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122312025-01-09T01:14:47.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122322025-01-09T01:14:47.323ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
122332025-01-09T01:14:47.323ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
122342025-01-09T01:14:47.323ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
122352025-01-09T01:14:47.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 422.35728ms iteration = 12 status = {"generation":2}
122362025-01-09T01:14:47.324ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 422.949373ms iteration = 23 status = null
122372025-01-09T01:14:47.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122382025-01-09T01:14:47.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122392025-01-09T01:14:47.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122402025-01-09T01:14:47.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122412025-01-09T01:14:47.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122422025-01-09T01:14:47.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122432025-01-09T01:14:47.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122442025-01-09T01:14:47.336ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
122452025-01-09T01:14:47.336ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
122462025-01-09T01:14:47.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0fd86211-7ae9-42d8-aecf-6147a0166fe7", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} })
122472025-01-09T01:14:47.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122482025-01-09T01:14:47.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122492025-01-09T01:14:47.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122502025-01-09T01:14:47.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122512025-01-09T01:14:47.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122522025-01-09T01:14:47.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122532025-01-09T01:14:47.345ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
122542025-01-09T01:14:47.345ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122552025-01-09T01:14:47.346ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4b262309-1ac1-4db0-89ec-9f6c1ec096d4", "date": "Thu, 09 Jan 2025 01:14:46 GMT"} })
122562025-01-09T01:14:47.348ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.782231ms iteration = 24 status = {}
122572025-01-09T01:14:47.386ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
122582025-01-09T01:14:47.386ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c079eaa3-34ea-44d9-9e73-8e1cdc561f95", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122592025-01-09T01:14:47.386ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122602025-01-09T01:14:47.388ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "148fe126-a538-4ee2-9b9e-5e69ffe206f1", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122612025-01-09T01:14:47.388ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122622025-01-09T01:14:47.389ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "75f0123c-8beb-4bd4-90cc-61a932e3d9dd", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122632025-01-09T01:14:47.389ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122642025-01-09T01:14:47.391ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
122652025-01-09T01:14:47.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 490.441055ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
122662025-01-09T01:14:47.481ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
122672025-01-09T01:14:47.481ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f4cb9c2-0fe9-4a62-9764-2790abeda30f", "content-length": "691", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
122682025-01-09T01:14:47.481ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
122692025-01-09T01:14:47.481ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
122702025-01-09T01:14:47.481ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
122712025-01-09T01:14:47.483ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 582.307858ms iteration = 24 status = {}
122722025-01-09T01:14:47.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122732025-01-09T01:14:47.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122742025-01-09T01:14:47.518ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
122752025-01-09T01:14:47.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122762025-01-09T01:14:47.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122772025-01-09T01:14:47.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
122782025-01-09T01:14:47.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f58497f-3317-4446-a8cf-c00b2fd60a17", "content-length": "134", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
122792025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
122802025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
122812025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
122822025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
122832025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122842025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122852025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122862025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
122872025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
122882025-01-09T01:14:47.528ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
122892025-01-09T01:14:47.529ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
122902025-01-09T01:14:47.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122912025-01-09T01:14:47.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122922025-01-09T01:14:47.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
122932025-01-09T01:14:47.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c45746a3-7af5-4f89-99c9-6b4c61b642cc", "content-length": "2", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
122942025-01-09T01:14:47.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
122952025-01-09T01:14:47.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8da56a65-34e3-401a-848d-b7afc74c4f74", "content-length": "52", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
122962025-01-09T01:14:47.531ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
122972025-01-09T01:14:47.531ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
122982025-01-09T01:14:47.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "273b9034-1540-4021-9d92-3cf62cd9a4eb", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
122992025-01-09T01:14:47.627ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
123002025-01-09T01:14:47.627ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123012025-01-09T01:14:47.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e84af0-8137-4cc2-9a68-dceefa407fe7", "content-length": "682", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
123022025-01-09T01:14:47.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123032025-01-09T01:14:47.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123042025-01-09T01:14:47.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123052025-01-09T01:14:47.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123062025-01-09T01:14:47.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123072025-01-09T01:14:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123082025-01-09T01:14:47.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123092025-01-09T01:14:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123102025-01-09T01:14:47.644ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
123112025-01-09T01:14:47.644ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
123122025-01-09T01:14:47.644ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 743.244819ms iteration = 23 status = {}
123132025-01-09T01:14:47.675ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
123142025-01-09T01:14:47.675ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:49724
123152025-01-09T01:14:47.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49724 req_id = 2937b7f7-f980-431d-a732-be1f7b186f7b roles = RoleSet { roles: {} } uri = /metrics/producers
123162025-01-09T01:14:47.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49724 req_id = 2937b7f7-f980-431d-a732-be1f7b186f7b resource = Database result = Ok(()) uri = /metrics/producers
123172025-01-09T01:14:47.709ZINFOnexus: assigned collector to new producer collector_id = d369b97b-e309-4e30-bf3f-1e4b78ee9699 file = nexus/src/app/oximeter.rs:76 producer_id = bc5aeb1b-883b-4e3c-84e4-bb4b98458327
123182025-01-09T01:14:47.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33717 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49724 req_id = 2937b7f7-f980-431d-a732-be1f7b186f7b response_code = 201 uri = /metrics/producers
123192025-01-09T01:14:47.709ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2937b7f7-f980-431d-a732-be1f7b186f7b", "content-length": "41", "date": "Thu, 09 Jan 2025 01:14:47 GMT"} })
123202025-01-09T01:14:47.711ZDEBGnexus (producer-registration-task): registered with nexus successfully
123212025-01-09T01:14:47.711ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
123222025-01-09T01:14:47.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea994ead-97d1-41a7-ba90-4b9553510396 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123232025-01-09T01:14:47.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea994ead-97d1-41a7-ba90-4b9553510396 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123242025-01-09T01:14:47.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ea994ead-97d1-41a7-ba90-4b9553510396 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123252025-01-09T01:14:48.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 086f75ad-6b28-4bb1-958e-4e0742f188cc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123262025-01-09T01:14:48.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 086f75ad-6b28-4bb1-958e-4e0742f188cc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123272025-01-09T01:14:48.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 086f75ad-6b28-4bb1-958e-4e0742f188cc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123282025-01-09T01:14:49.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e79d6fa8-2914-4174-a99f-3dec10c6e1c5 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123292025-01-09T01:14:49.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e79d6fa8-2914-4174-a99f-3dec10c6e1c5 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123302025-01-09T01:14:49.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e79d6fa8-2914-4174-a99f-3dec10c6e1c5 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123312025-01-09T01:14:49.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 71365944-bdad-413d-ba62-b202158432e0 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
123322025-01-09T01:14:50.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cd2c0cb-ca11-4a53-abcb-0005ed588af7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123332025-01-09T01:14:50.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cd2c0cb-ca11-4a53-abcb-0005ed588af7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123342025-01-09T01:14:50.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cd2c0cb-ca11-4a53-abcb-0005ed588af7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123352025-01-09T01:14:51.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5cd4ea45-4b12-44c8-bc91-b1beac828c2e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123362025-01-09T01:14:51.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5cd4ea45-4b12-44c8-bc91-b1beac828c2e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123372025-01-09T01:14:51.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5cd4ea45-4b12-44c8-bc91-b1beac828c2e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123382025-01-09T01:14:52.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1205b09d-df20-4488-9f7c-52f107569b79 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123392025-01-09T01:14:52.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1205b09d-df20-4488-9f7c-52f107569b79 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123402025-01-09T01:14:52.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1205b09d-df20-4488-9f7c-52f107569b79 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123412025-01-09T01:14:54.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 52ceafa2-2ded-43b3-84c4-1fa84a3b4628 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123422025-01-09T01:14:54.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 52ceafa2-2ded-43b3-84c4-1fa84a3b4628 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123432025-01-09T01:14:54.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 52ceafa2-2ded-43b3-84c4-1fa84a3b4628 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123442025-01-09T01:14:55.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2644c98-ab91-4803-bf97-5b2ad44244fb roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123452025-01-09T01:14:55.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2644c98-ab91-4803-bf97-5b2ad44244fb resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123462025-01-09T01:14:55.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f2644c98-ab91-4803-bf97-5b2ad44244fb response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123472025-01-09T01:14:56.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4c98604-ffca-4c49-b253-b0bc9e70bfe2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123482025-01-09T01:14:56.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4c98604-ffca-4c49-b253-b0bc9e70bfe2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123492025-01-09T01:14:56.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4c98604-ffca-4c49-b253-b0bc9e70bfe2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123502025-01-09T01:14:56.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
123512025-01-09T01:14:56.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
123522025-01-09T01:14:56.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123532025-01-09T01:14:56.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123542025-01-09T01:14:56.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123552025-01-09T01:14:56.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123562025-01-09T01:14:56.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123572025-01-09T01:14:56.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123582025-01-09T01:14:56.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123592025-01-09T01:14:56.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.220066ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123602025-01-09T01:14:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123612025-01-09T01:14:56.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123622025-01-09T01:14:56.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123632025-01-09T01:14:56.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123642025-01-09T01:14:56.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123652025-01-09T01:14:56.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123662025-01-09T01:14:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
123672025-01-09T01:14:56.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123682025-01-09T01:14:56.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123692025-01-09T01:14:56.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
123702025-01-09T01:14:56.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.779334ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
123712025-01-09T01:14:57.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c343b12-4aad-4b26-a540-03674676a39d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123722025-01-09T01:14:57.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c343b12-4aad-4b26-a540-03674676a39d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123732025-01-09T01:14:57.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 8c343b12-4aad-4b26-a540-03674676a39d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123742025-01-09T01:14:58.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4b87dcd-72c4-45a6-b3c6-5bea3e18729b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123752025-01-09T01:14:58.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4b87dcd-72c4-45a6-b3c6-5bea3e18729b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123762025-01-09T01:14:58.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f4b87dcd-72c4-45a6-b3c6-5bea3e18729b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123772025-01-09T01:14:59.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d0ec51a0-231d-4b5c-8002-3b2e0fcb0a06 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123782025-01-09T01:14:59.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d0ec51a0-231d-4b5c-8002-3b2e0fcb0a06 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123792025-01-09T01:14:59.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d0ec51a0-231d-4b5c-8002-3b2e0fcb0a06 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123802025-01-09T01:14:59.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 21e66282-2c5f-4732-b16a-74e8b71c8eb4 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
123812025-01-09T01:14:59.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 21e66282-2c5f-4732-b16a-74e8b71c8eb4 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
123822025-01-09T01:14:59.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 21e66282-2c5f-4732-b16a-74e8b71c8eb4 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
123832025-01-09T01:14:59.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 433eba1a-87d1-4276-bac7-dd866b8c86e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
123842025-01-09T01:14:59.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 433eba1a-87d1-4276-bac7-dd866b8c86e1 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
123852025-01-09T01:14:59.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 433eba1a-87d1-4276-bac7-dd866b8c86e1 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
123862025-01-09T01:14:59.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = eb1b94ec-a381-4671-9516-68670a4f80d9 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
123872025-01-09T01:15:00.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4f8f7424-4309-4a5f-a26c-8c359402057e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123882025-01-09T01:15:00.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4f8f7424-4309-4a5f-a26c-8c359402057e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123892025-01-09T01:15:00.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4f8f7424-4309-4a5f-a26c-8c359402057e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123902025-01-09T01:15:01.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 06dca9bf-6ca2-48e0-a3b5-ff2633c8c851 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123912025-01-09T01:15:01.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 06dca9bf-6ca2-48e0-a3b5-ff2633c8c851 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123922025-01-09T01:15:01.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 06dca9bf-6ca2-48e0-a3b5-ff2633c8c851 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123932025-01-09T01:15:02.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab6a1447-4650-4646-b44a-a1888632eb31 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123942025-01-09T01:15:02.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab6a1447-4650-4646-b44a-a1888632eb31 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123952025-01-09T01:15:02.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ab6a1447-4650-4646-b44a-a1888632eb31 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123962025-01-09T01:15:03.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 43d56ba8-5597-4ff3-9f0b-11c617a424e2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123972025-01-09T01:15:03.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 43d56ba8-5597-4ff3-9f0b-11c617a424e2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123982025-01-09T01:15:03.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 43d56ba8-5597-4ff3-9f0b-11c617a424e2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
123992025-01-09T01:15:04.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a73cc76-4cf7-4237-acf7-ff249d838772 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124002025-01-09T01:15:04.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a73cc76-4cf7-4237-acf7-ff249d838772 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124012025-01-09T01:15:04.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2a73cc76-4cf7-4237-acf7-ff249d838772 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124022025-01-09T01:15:05.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a47f4c1-3a35-4ada-b215-7928b59eab6a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124032025-01-09T01:15:05.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a47f4c1-3a35-4ada-b215-7928b59eab6a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124042025-01-09T01:15:05.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 6a47f4c1-3a35-4ada-b215-7928b59eab6a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124052025-01-09T01:15:06.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5f3f3f40-36c6-496b-9632-83ed3b1f93e0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124062025-01-09T01:15:06.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5f3f3f40-36c6-496b-9632-83ed3b1f93e0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124072025-01-09T01:15:06.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5f3f3f40-36c6-496b-9632-83ed3b1f93e0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124082025-01-09T01:15:06.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
124092025-01-09T01:15:06.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
124102025-01-09T01:15:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124112025-01-09T01:15:06.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124122025-01-09T01:15:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124132025-01-09T01:15:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124142025-01-09T01:15:06.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124152025-01-09T01:15:06.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124162025-01-09T01:15:06.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124172025-01-09T01:15:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124182025-01-09T01:15:06.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124192025-01-09T01:15:06.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124202025-01-09T01:15:06.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124212025-01-09T01:15:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
124222025-01-09T01:15:06.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124232025-01-09T01:15:06.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124242025-01-09T01:15:06.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
124252025-01-09T01:15:06.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.228687ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
124262025-01-09T01:15:06.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124272025-01-09T01:15:06.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124282025-01-09T01:15:06.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.050817ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124292025-01-09T01:15:07.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fca47697-2c7f-4ee6-b040-16f0cc4470dc roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124302025-01-09T01:15:07.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fca47697-2c7f-4ee6-b040-16f0cc4470dc resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124312025-01-09T01:15:07.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = fca47697-2c7f-4ee6-b040-16f0cc4470dc response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124322025-01-09T01:15:08.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 57995f7e-72c6-4276-b322-ace4d3ad4d25 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124332025-01-09T01:15:08.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 57995f7e-72c6-4276-b322-ace4d3ad4d25 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124342025-01-09T01:15:08.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 57995f7e-72c6-4276-b322-ace4d3ad4d25 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124352025-01-09T01:15:09.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37258bf9-aa1f-4a08-bce2-4b5390aaf167 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124362025-01-09T01:15:09.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37258bf9-aa1f-4a08-bce2-4b5390aaf167 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124372025-01-09T01:15:09.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 37258bf9-aa1f-4a08-bce2-4b5390aaf167 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124382025-01-09T01:15:09.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 703 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 7d55f713-a0a3-4084-b767-8ac9f04bdf8b response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
124392025-01-09T01:15:10.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b206ec0f-57af-4ca8-99db-2f645159d2ae roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124402025-01-09T01:15:10.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b206ec0f-57af-4ca8-99db-2f645159d2ae resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124412025-01-09T01:15:10.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = b206ec0f-57af-4ca8-99db-2f645159d2ae response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124422025-01-09T01:15:11.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16852227-2b41-47fb-b028-a91d0978390b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124432025-01-09T01:15:11.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16852227-2b41-47fb-b028-a91d0978390b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124442025-01-09T01:15:11.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 16852227-2b41-47fb-b028-a91d0978390b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124452025-01-09T01:15:12.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3d1ecf54-3af9-4323-a8f2-6fd360727c93 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124462025-01-09T01:15:12.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3d1ecf54-3af9-4323-a8f2-6fd360727c93 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124472025-01-09T01:15:12.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3d1ecf54-3af9-4323-a8f2-6fd360727c93 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124482025-01-09T01:15:13.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2b093033-e25c-47bf-9c2d-cdf036013437 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124492025-01-09T01:15:13.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2b093033-e25c-47bf-9c2d-cdf036013437 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124502025-01-09T01:15:13.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2b093033-e25c-47bf-9c2d-cdf036013437 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124512025-01-09T01:15:14.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2d427ac-43cc-488c-a106-7bd994d55562 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124522025-01-09T01:15:14.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2d427ac-43cc-488c-a106-7bd994d55562 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124532025-01-09T01:15:14.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = e2d427ac-43cc-488c-a106-7bd994d55562 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124542025-01-09T01:15:14.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 0931c5da-1e83-4a18-b01e-049391243656 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
124552025-01-09T01:15:14.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 0931c5da-1e83-4a18-b01e-049391243656 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
124562025-01-09T01:15:14.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 0931c5da-1e83-4a18-b01e-049391243656 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
124572025-01-09T01:15:14.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = bc8c8e07-abb7-4ef6-a84b-6817ab6daac8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
124582025-01-09T01:15:14.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = bc8c8e07-abb7-4ef6-a84b-6817ab6daac8 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
124592025-01-09T01:15:14.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = bc8c8e07-abb7-4ef6-a84b-6817ab6daac8 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
124602025-01-09T01:15:15.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c69ea2f8-c59e-427f-8323-8c1ffb35bf3a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124612025-01-09T01:15:15.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c69ea2f8-c59e-427f-8323-8c1ffb35bf3a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124622025-01-09T01:15:15.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c69ea2f8-c59e-427f-8323-8c1ffb35bf3a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124632025-01-09T01:15:16.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bd68a9c-fed8-44d4-a1bb-6601e304c3e3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124642025-01-09T01:15:16.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bd68a9c-fed8-44d4-a1bb-6601e304c3e3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124652025-01-09T01:15:16.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0bd68a9c-fed8-44d4-a1bb-6601e304c3e3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
124662025-01-09T01:15:16.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
124672025-01-09T01:15:16.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124682025-01-09T01:15:16.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
124692025-01-09T01:15:16.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
124702025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
124712025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124722025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
124732025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
124742025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
124752025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124762025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124772025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
124782025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
124792025-01-09T01:15:16.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
124802025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124812025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
124822025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
124832025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
124842025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124852025-01-09T01:15:16.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124862025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
124872025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
124882025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
124892025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124902025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
124912025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
124922025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124932025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
124942025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
124952025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124962025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124972025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
124982025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124992025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
125002025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
125012025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125022025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125032025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125042025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
125052025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
125062025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
125072025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125082025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125092025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125102025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125112025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125122025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125132025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125142025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125152025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125162025-01-09T01:15:16.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125172025-01-09T01:15:16.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1760, tv_nsec: 362538770 } })
125182025-01-09T01:15:16.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1760, tv_nsec: 362675753 } })
125192025-01-09T01:15:16.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
125202025-01-09T01:15:16.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
125212025-01-09T01:15:16.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125222025-01-09T01:15:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.335265ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
125232025-01-09T01:15:16.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.865348ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
125242025-01-09T01:15:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
125252025-01-09T01:15:16.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.683206ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
125262025-01-09T01:15:16.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125272025-01-09T01:15:16.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125282025-01-09T01:15:16.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125292025-01-09T01:15:16.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125302025-01-09T01:15:16.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125312025-01-09T01:15:16.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125322025-01-09T01:15:16.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125332025-01-09T01:15:16.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
125342025-01-09T01:15:16.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125352025-01-09T01:15:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125362025-01-09T01:15:16.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125372025-01-09T01:15:16.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125382025-01-09T01:15:16.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125392025-01-09T01:15:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
125402025-01-09T01:15:16.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125412025-01-09T01:15:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125422025-01-09T01:15:16.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125432025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
125442025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125452025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125462025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125472025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125482025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125492025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125502025-01-09T01:15:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125512025-01-09T01:15:16.916ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1760, tv_nsec: 374800817 } })
125522025-01-09T01:15:16.916ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
125532025-01-09T01:15:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125542025-01-09T01:15:16.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125552025-01-09T01:15:16.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125562025-01-09T01:15:16.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125572025-01-09T01:15:16.917ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125582025-01-09T01:15:16.917ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125592025-01-09T01:15:16.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125602025-01-09T01:15:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125612025-01-09T01:15:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125622025-01-09T01:15:16.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.043862ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125632025-01-09T01:15:16.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125642025-01-09T01:15:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125652025-01-09T01:15:16.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125662025-01-09T01:15:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125672025-01-09T01:15:16.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125682025-01-09T01:15:16.922ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
125692025-01-09T01:15:16.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.849361ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
125702025-01-09T01:15:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
125712025-01-09T01:15:16.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125722025-01-09T01:15:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125732025-01-09T01:15:16.936ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
125742025-01-09T01:15:16.936ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.035078ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
125752025-01-09T01:15:16.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125762025-01-09T01:15:16.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125772025-01-09T01:15:16.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125782025-01-09T01:15:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125792025-01-09T01:15:16.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125802025-01-09T01:15:16.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125812025-01-09T01:15:16.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125822025-01-09T01:15:16.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125832025-01-09T01:15:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125842025-01-09T01:15:16.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
125852025-01-09T01:15:16.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125862025-01-09T01:15:16.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125872025-01-09T01:15:16.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125882025-01-09T01:15:16.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125892025-01-09T01:15:16.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125902025-01-09T01:15:16.948ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
125912025-01-09T01:15:16.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 45.997988ms iteration = 24 status = 0
125922025-01-09T01:15:16.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
125932025-01-09T01:15:16.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.575454ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125942025-01-09T01:15:16.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125952025-01-09T01:15:16.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125962025-01-09T01:15:16.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125972025-01-09T01:15:16.950ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125982025-01-09T01:15:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125992025-01-09T01:15:16.952ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126002025-01-09T01:15:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126012025-01-09T01:15:16.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126022025-01-09T01:15:16.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126032025-01-09T01:15:16.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126042025-01-09T01:15:16.957ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
126052025-01-09T01:15:16.957ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
126062025-01-09T01:15:16.957ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 55.802769ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
126072025-01-09T01:15:16.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
126082025-01-09T01:15:16.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126092025-01-09T01:15:16.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126102025-01-09T01:15:16.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126112025-01-09T01:15:16.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126122025-01-09T01:15:16.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.675806ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
126132025-01-09T01:15:16.997ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.750691ms iteration = 27 status = {"physical_disks_added":0}
126142025-01-09T01:15:17.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
126152025-01-09T01:15:17.012ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126162025-01-09T01:15:17.013ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "317b49c3-ade3-437d-b939-7ee872ffe147", "content-length": "26", "date": "Thu, 09 Jan 2025 01:15:16 GMT"} })
126172025-01-09T01:15:17.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126182025-01-09T01:15:17.015ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
126192025-01-09T01:15:17.067ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
126202025-01-09T01:15:17.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126212025-01-09T01:15:17.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126222025-01-09T01:15:17.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
126232025-01-09T01:15:17.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126242025-01-09T01:15:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126252025-01-09T01:15:17.094ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
126262025-01-09T01:15:17.094ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126272025-01-09T01:15:17.094ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a951442-0473-4838-9de1-4042570e6390", "content-length": "26", "date": "Thu, 09 Jan 2025 01:15:16 GMT"} })
126282025-01-09T01:15:17.094ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126292025-01-09T01:15:17.097ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
126302025-01-09T01:15:17.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 195.334167ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
126312025-01-09T01:15:17.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
126322025-01-09T01:15:17.103ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
126332025-01-09T01:15:17.104ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d0b3e7c-98b7-4bd4-aea1-ae4652217abd", "content-length": "26", "date": "Thu, 09 Jan 2025 01:15:16 GMT"} })
126342025-01-09T01:15:17.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
126352025-01-09T01:15:17.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
126362025-01-09T01:15:17.110ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58923194-06a7-4581-9f63-61c000cb9b3b", "content-length": "372", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126372025-01-09T01:15:17.110ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
126382025-01-09T01:15:17.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126392025-01-09T01:15:17.110ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "167177b4-0d71-4fd2-907d-bcda9261df9d", "content-length": "2", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126402025-01-09T01:15:17.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126412025-01-09T01:15:17.111ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126422025-01-09T01:15:17.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126432025-01-09T01:15:17.117ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.132736ms iteration = 24 status = null
126442025-01-09T01:15:17.129ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
126452025-01-09T01:15:17.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
126462025-01-09T01:15:17.133ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b85f9991-76d3-43ea-8b82-ee1fc93c8257", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126472025-01-09T01:15:17.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126482025-01-09T01:15:17.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126492025-01-09T01:15:17.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126502025-01-09T01:15:17.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126512025-01-09T01:15:17.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126522025-01-09T01:15:17.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126532025-01-09T01:15:17.162ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
126542025-01-09T01:15:17.163ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e598b5ae-90fa-4e63-b0f1-1cd36c15cf9d", "content-length": "691", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126552025-01-09T01:15:17.163ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
126562025-01-09T01:15:17.163ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
126572025-01-09T01:15:17.163ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
126582025-01-09T01:15:17.164ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 262.971973ms iteration = 25 status = {}
126592025-01-09T01:15:17.166ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
126602025-01-09T01:15:17.166ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126612025-01-09T01:15:17.166ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ebb6f830-84b9-4bec-b7de-16ab6979b226", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126622025-01-09T01:15:17.168ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.132214ms iteration = 25 status = {}
126632025-01-09T01:15:17.179ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.541884ms iteration = 24 status = {}
126642025-01-09T01:15:17.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126652025-01-09T01:15:17.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126662025-01-09T01:15:17.250ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
126672025-01-09T01:15:17.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126682025-01-09T01:15:17.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126692025-01-09T01:15:17.259ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
126702025-01-09T01:15:17.259ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb2e63f-f63f-419b-abb8-6ceb78628cae", "content-length": "134", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126712025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
126722025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
126732025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
126742025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
126752025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126762025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126772025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126782025-01-09T01:15:17.259ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126792025-01-09T01:15:17.260ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126802025-01-09T01:15:17.260ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126812025-01-09T01:15:17.260ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
126822025-01-09T01:15:17.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126832025-01-09T01:15:17.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126842025-01-09T01:15:17.262ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
126852025-01-09T01:15:17.263ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7cc11b1-93b1-4ac0-aa1e-b5e20739751b", "content-length": "2", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126862025-01-09T01:15:17.263ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
126872025-01-09T01:15:17.263ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed9054b4-9cd4-4023-bf5c-f4a5e04ed3c5", "content-length": "52", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126882025-01-09T01:15:17.263ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
126892025-01-09T01:15:17.263ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126902025-01-09T01:15:17.376ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5f4f2715-e1db-4e12-b0a0-427888eb83d5", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126912025-01-09T01:15:17.376ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
126922025-01-09T01:15:17.376ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
126932025-01-09T01:15:17.376ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "59abc401-38df-4818-936b-7a557241f681", "content-length": "682", "date": "Thu, 09 Jan 2025 01:15:17 GMT"} })
126942025-01-09T01:15:17.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126952025-01-09T01:15:17.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126962025-01-09T01:15:17.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126972025-01-09T01:15:17.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126982025-01-09T01:15:17.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126992025-01-09T01:15:17.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127002025-01-09T01:15:17.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127012025-01-09T01:15:17.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127022025-01-09T01:15:17.391ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.979004ms iteration = 24 status = {}
127032025-01-09T01:15:17.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4ed8f9c7-ac1b-4353-9cb1-c23dd0b1182e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127042025-01-09T01:15:17.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4ed8f9c7-ac1b-4353-9cb1-c23dd0b1182e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127052025-01-09T01:15:17.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4ed8f9c7-ac1b-4353-9cb1-c23dd0b1182e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127062025-01-09T01:15:18.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 866fa599-5684-458c-967b-683a91feacf0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127072025-01-09T01:15:18.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 866fa599-5684-458c-967b-683a91feacf0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127082025-01-09T01:15:18.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 866fa599-5684-458c-967b-683a91feacf0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127092025-01-09T01:15:19.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 681fc7c1-c2cd-4e3b-b3a6-665c6c15d2df roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127102025-01-09T01:15:19.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 681fc7c1-c2cd-4e3b-b3a6-665c6c15d2df resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127112025-01-09T01:15:19.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 681fc7c1-c2cd-4e3b-b3a6-665c6c15d2df response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127122025-01-09T01:15:19.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = eb13fbf9-d3e1-4d5f-893c-c4b87038fc15 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
127132025-01-09T01:15:20.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9631b359-80b0-4073-b200-0c8d0fbd567e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127142025-01-09T01:15:20.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9631b359-80b0-4073-b200-0c8d0fbd567e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127152025-01-09T01:15:20.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9631b359-80b0-4073-b200-0c8d0fbd567e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127162025-01-09T01:15:21.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c24a1ba1-af12-4f52-865d-3c1429f98e66 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127172025-01-09T01:15:21.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c24a1ba1-af12-4f52-865d-3c1429f98e66 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127182025-01-09T01:15:21.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = c24a1ba1-af12-4f52-865d-3c1429f98e66 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127192025-01-09T01:15:22.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 882e6f8c-e604-4cae-a1d2-998634dd41f0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127202025-01-09T01:15:22.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 882e6f8c-e604-4cae-a1d2-998634dd41f0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127212025-01-09T01:15:22.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 882e6f8c-e604-4cae-a1d2-998634dd41f0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127222025-01-09T01:15:23.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1722dbbf-5d57-4cb4-8668-12073cfc331d roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127232025-01-09T01:15:23.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1722dbbf-5d57-4cb4-8668-12073cfc331d resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127242025-01-09T01:15:23.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 1722dbbf-5d57-4cb4-8668-12073cfc331d response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127252025-01-09T01:15:24.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c63d56c-8df0-45ab-80a8-a7df57d86977 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127262025-01-09T01:15:24.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c63d56c-8df0-45ab-80a8-a7df57d86977 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127272025-01-09T01:15:24.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9c63d56c-8df0-45ab-80a8-a7df57d86977 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127282025-01-09T01:15:25.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 087f68b9-e9c7-4794-a422-b7e479681970 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127292025-01-09T01:15:25.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 087f68b9-e9c7-4794-a422-b7e479681970 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127302025-01-09T01:15:25.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 087f68b9-e9c7-4794-a422-b7e479681970 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127312025-01-09T01:15:26.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 98dd2123-e5e9-4216-9fd8-2339937c6288 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127322025-01-09T01:15:26.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 98dd2123-e5e9-4216-9fd8-2339937c6288 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127332025-01-09T01:15:26.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 98dd2123-e5e9-4216-9fd8-2339937c6288 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127342025-01-09T01:15:26.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
127352025-01-09T01:15:26.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
127362025-01-09T01:15:26.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127372025-01-09T01:15:26.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127382025-01-09T01:15:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127392025-01-09T01:15:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127402025-01-09T01:15:26.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127412025-01-09T01:15:26.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127422025-01-09T01:15:26.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127432025-01-09T01:15:26.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.668403ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127442025-01-09T01:15:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127452025-01-09T01:15:26.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127462025-01-09T01:15:26.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127472025-01-09T01:15:26.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127482025-01-09T01:15:26.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127492025-01-09T01:15:26.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127502025-01-09T01:15:26.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
127512025-01-09T01:15:26.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127522025-01-09T01:15:26.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127532025-01-09T01:15:26.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
127542025-01-09T01:15:26.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.752165ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
127552025-01-09T01:15:27.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2779e6ae-5d30-4a2f-86ac-700e4dc402a4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127562025-01-09T01:15:27.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2779e6ae-5d30-4a2f-86ac-700e4dc402a4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127572025-01-09T01:15:27.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2779e6ae-5d30-4a2f-86ac-700e4dc402a4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127582025-01-09T01:15:28.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0889ed6b-8a8b-4a98-9c7a-b910c7ebe150 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127592025-01-09T01:15:28.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0889ed6b-8a8b-4a98-9c7a-b910c7ebe150 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127602025-01-09T01:15:28.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0889ed6b-8a8b-4a98-9c7a-b910c7ebe150 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127612025-01-09T01:15:29.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35866aa1-2a90-4964-9e1f-32ded53a42d1 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127622025-01-09T01:15:29.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35866aa1-2a90-4964-9e1f-32ded53a42d1 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127632025-01-09T01:15:29.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 35866aa1-2a90-4964-9e1f-32ded53a42d1 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127642025-01-09T01:15:29.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 46af1b61-f9c6-44cc-8e41-65fba1c8bf2e response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
127652025-01-09T01:15:30.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 262b18da-13cd-4430-983b-878ce84b0a6a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127662025-01-09T01:15:30.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 262b18da-13cd-4430-983b-878ce84b0a6a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127672025-01-09T01:15:30.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 262b18da-13cd-4430-983b-878ce84b0a6a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127682025-01-09T01:15:31.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0334d86b-4d4d-4850-aa6f-dc2f8e3cba24 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127692025-01-09T01:15:31.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0334d86b-4d4d-4850-aa6f-dc2f8e3cba24 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127702025-01-09T01:15:31.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0334d86b-4d4d-4850-aa6f-dc2f8e3cba24 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127712025-01-09T01:15:32.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5e2aecb4-53ab-4551-a45d-8beacc05e987 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127722025-01-09T01:15:32.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5e2aecb4-53ab-4551-a45d-8beacc05e987 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127732025-01-09T01:15:32.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5e2aecb4-53ab-4551-a45d-8beacc05e987 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127742025-01-09T01:15:33.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6fa33c3-984a-44b3-b7f2-1391532277a3 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127752025-01-09T01:15:33.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6fa33c3-984a-44b3-b7f2-1391532277a3 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127762025-01-09T01:15:33.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a6fa33c3-984a-44b3-b7f2-1391532277a3 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127772025-01-09T01:15:34.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a3b96d9a-160f-4e21-bf66-fea8f901eb38 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127782025-01-09T01:15:34.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a3b96d9a-160f-4e21-bf66-fea8f901eb38 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127792025-01-09T01:15:34.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a3b96d9a-160f-4e21-bf66-fea8f901eb38 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127802025-01-09T01:15:35.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3311b5ae-6f98-4e1a-ad4c-90479a16c9a2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127812025-01-09T01:15:35.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3311b5ae-6f98-4e1a-ad4c-90479a16c9a2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127822025-01-09T01:15:35.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3311b5ae-6f98-4e1a-ad4c-90479a16c9a2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
127832025-01-09T01:15:36.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
127842025-01-09T01:15:36.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
127852025-01-09T01:15:36.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127862025-01-09T01:15:36.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127872025-01-09T01:15:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127882025-01-09T01:15:36.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127892025-01-09T01:15:36.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127902025-01-09T01:15:36.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127912025-01-09T01:15:36.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127922025-01-09T01:15:36.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127932025-01-09T01:15:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127942025-01-09T01:15:36.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127952025-01-09T01:15:36.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127962025-01-09T01:15:36.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
127972025-01-09T01:15:36.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127982025-01-09T01:15:36.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127992025-01-09T01:15:36.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
128002025-01-09T01:15:36.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.587134ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
128012025-01-09T01:15:36.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128022025-01-09T01:15:36.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128032025-01-09T01:15:36.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.162765ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128042025-01-09T01:15:36.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd5af11d-c446-49e9-8211-082dd45cac35 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128052025-01-09T01:15:36.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd5af11d-c446-49e9-8211-082dd45cac35 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128062025-01-09T01:15:36.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dd5af11d-c446-49e9-8211-082dd45cac35 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128072025-01-09T01:15:37.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee5b9471-05a1-4b1f-b50c-d418d7432b96 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128082025-01-09T01:15:37.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee5b9471-05a1-4b1f-b50c-d418d7432b96 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128092025-01-09T01:15:37.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = ee5b9471-05a1-4b1f-b50c-d418d7432b96 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128102025-01-09T01:15:39.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f30b35c2-2734-4511-a496-755bf03a6d28 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128112025-01-09T01:15:39.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f30b35c2-2734-4511-a496-755bf03a6d28 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128122025-01-09T01:15:39.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f30b35c2-2734-4511-a496-755bf03a6d28 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128132025-01-09T01:15:39.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 868 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 0f307d78-19d9-434c-9dc0-34769d360a44 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
128142025-01-09T01:15:40.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bcb739cd-d16f-4873-9e25-8155ccfa8f6a roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128152025-01-09T01:15:40.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bcb739cd-d16f-4873-9e25-8155ccfa8f6a resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128162025-01-09T01:15:40.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = bcb739cd-d16f-4873-9e25-8155ccfa8f6a response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128172025-01-09T01:15:41.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4174e9d2-526a-42e0-8c5d-36b391d0eae6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128182025-01-09T01:15:41.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4174e9d2-526a-42e0-8c5d-36b391d0eae6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128192025-01-09T01:15:41.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4174e9d2-526a-42e0-8c5d-36b391d0eae6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128202025-01-09T01:15:42.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3e92ce75-efc7-4575-8db3-0a951b734ad7 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128212025-01-09T01:15:42.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3e92ce75-efc7-4575-8db3-0a951b734ad7 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128222025-01-09T01:15:42.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3e92ce75-efc7-4575-8db3-0a951b734ad7 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128232025-01-09T01:15:43.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b164acb-301d-496b-bd76-23691c66c1ca roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128242025-01-09T01:15:43.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b164acb-301d-496b-bd76-23691c66c1ca resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128252025-01-09T01:15:43.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9b164acb-301d-496b-bd76-23691c66c1ca response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128262025-01-09T01:15:44.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2943ddb-cea5-447b-a25d-ef6981373339 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128272025-01-09T01:15:44.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2943ddb-cea5-447b-a25d-ef6981373339 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128282025-01-09T01:15:44.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = d2943ddb-cea5-447b-a25d-ef6981373339 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128292025-01-09T01:15:45.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 20bf6e7b-ba76-47ba-9a74-7303bd234b76 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128302025-01-09T01:15:45.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 20bf6e7b-ba76-47ba-9a74-7303bd234b76 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128312025-01-09T01:15:45.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 20bf6e7b-ba76-47ba-9a74-7303bd234b76 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128322025-01-09T01:15:46.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 544290e8-b02f-4e14-bd59-e8d410104689 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128332025-01-09T01:15:46.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 544290e8-b02f-4e14-bd59-e8d410104689 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128342025-01-09T01:15:46.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 544290e8-b02f-4e14-bd59-e8d410104689 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
128352025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
128362025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
128372025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128382025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
128392025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
128402025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128412025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
128422025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128432025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
128442025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
128452025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
128462025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
128472025-01-09T01:15:46.900ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:05:46.900835954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
128482025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
128492025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
128502025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
128512025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
128522025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128532025-01-09T01:15:46.900ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
128542025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128552025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128562025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128572025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
128582025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128592025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
128602025-01-09T01:15:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6135d2f0-37b8-443e-a741-5ec4e46a4ef0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a98745ae-2f0a-4dbf-9d35-ec0663205372.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7e5d812-3b66-48ae-9425-d561b75ab23b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1790, tv_nsec: 359847030 } })
128612025-01-09T01:15:46.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71878588-3bc5-4be9-bddb-893f09285184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("870344ce-2728-444f-8d5a-e3771e15477e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1790, tv_nsec: 359923072 } })
128622025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
128632025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
128642025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
128652025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128662025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
128672025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
128682025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128692025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128702025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
128712025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
128722025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128732025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
128742025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128752025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
128762025-01-09T01:15:46.901ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
128772025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128782025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
128792025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128802025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
128812025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
128822025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
128832025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
128842025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128852025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
128862025-01-09T01:15:46.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4
128872025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.05\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4"}
128882025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
128892025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
128902025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
128912025-01-09T01:15:46.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128922025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
128932025-01-09T01:15:46.902ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
128942025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
128952025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128962025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
128972025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
128982025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128992025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
129002025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129012025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
129022025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
129032025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
129042025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129052025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
129062025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
129072025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129082025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129092025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
129102025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.448252ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
129112025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
129122025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129132025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129142025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129152025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129162025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129172025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
129182025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.472023ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
129192025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129202025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129212025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
129222025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129232025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129242025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129252025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
129262025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129272025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129282025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129292025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
129302025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129312025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129322025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129332025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129342025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129352025-01-09T01:15:46.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129362025-01-09T01:15:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129372025-01-09T01:15:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129382025-01-09T01:15:46.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129392025-01-09T01:15:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129402025-01-09T01:15:46.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129412025-01-09T01:15:46.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129422025-01-09T01:15:46.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:05:46.900835954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
129432025-01-09T01:15:46.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.948312ms iteration = 13 status = {"expiration":"2025-01-09T01:05:46.900835954Z","pruned":[]}
129442025-01-09T01:15:46.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129452025-01-09T01:15:46.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1790, tv_nsec: 364891504 } })
129462025-01-09T01:15:46.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
129472025-01-09T01:15:46.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129482025-01-09T01:15:46.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129492025-01-09T01:15:46.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129502025-01-09T01:15:46.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129512025-01-09T01:15:46.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129522025-01-09T01:15:46.908ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1790, tv_nsec: 367021592 } })
129532025-01-09T01:15:46.908ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
129542025-01-09T01:15:46.909ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.912939ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
129552025-01-09T01:15:46.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.827249ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
129562025-01-09T01:15:46.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129572025-01-09T01:15:46.912ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129582025-01-09T01:15:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129592025-01-09T01:15:46.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129602025-01-09T01:15:46.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129612025-01-09T01:15:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
129622025-01-09T01:15:46.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129632025-01-09T01:15:46.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129642025-01-09T01:15:46.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129652025-01-09T01:15:46.919ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129662025-01-09T01:15:46.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129672025-01-09T01:15:46.920ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
129682025-01-09T01:15:46.920ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
129692025-01-09T01:15:46.920ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.686751ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
129702025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129712025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129722025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129732025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129742025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
129752025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129762025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129772025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129782025-01-09T01:15:46.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129792025-01-09T01:15:46.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129802025-01-09T01:15:46.927ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.027985ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
129812025-01-09T01:15:46.927ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129822025-01-09T01:15:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129832025-01-09T01:15:46.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129842025-01-09T01:15:46.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129852025-01-09T01:15:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129862025-01-09T01:15:46.929ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129872025-01-09T01:15:46.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129882025-01-09T01:15:46.929ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129892025-01-09T01:15:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129902025-01-09T01:15:46.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129912025-01-09T01:15:46.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129922025-01-09T01:15:46.938ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129932025-01-09T01:15:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129942025-01-09T01:15:46.942ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129952025-01-09T01:15:46.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129962025-01-09T01:15:46.942ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129972025-01-09T01:15:46.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129982025-01-09T01:15:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129992025-01-09T01:15:46.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130002025-01-09T01:15:46.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130012025-01-09T01:15:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130022025-01-09T01:15:46.948ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130032025-01-09T01:15:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130042025-01-09T01:15:46.950ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
130052025-01-09T01:15:46.950ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
130062025-01-09T01:15:46.950ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
130072025-01-09T01:15:46.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130082025-01-09T01:15:46.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130092025-01-09T01:15:46.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130102025-01-09T01:15:46.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130112025-01-09T01:15:46.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130122025-01-09T01:15:46.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130132025-01-09T01:15:46.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130142025-01-09T01:15:46.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130152025-01-09T01:15:46.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
130162025-01-09T01:15:46.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130172025-01-09T01:15:46.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130182025-01-09T01:15:46.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130192025-01-09T01:15:46.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130202025-01-09T01:15:46.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130212025-01-09T01:15:46.959ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 57.558899ms iteration = 6 status = {"nsuccess":5}
130222025-01-09T01:15:46.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130232025-01-09T01:15:46.960ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130242025-01-09T01:15:46.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130252025-01-09T01:15:46.963ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1790, tv_nsec: 421373678 } })
130262025-01-09T01:15:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130272025-01-09T01:15:46.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130282025-01-09T01:15:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
130292025-01-09T01:15:46.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130302025-01-09T01:15:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130312025-01-09T01:15:46.964ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
130322025-01-09T01:15:46.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130332025-01-09T01:15:46.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130342025-01-09T01:15:46.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130352025-01-09T01:15:46.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130362025-01-09T01:15:46.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130372025-01-09T01:15:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130382025-01-09T01:15:46.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130392025-01-09T01:15:46.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130402025-01-09T01:15:46.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
130412025-01-09T01:15:46.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
130422025-01-09T01:15:46.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130432025-01-09T01:15:46.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.119352ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
130442025-01-09T01:15:46.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130452025-01-09T01:15:46.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130462025-01-09T01:15:46.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130472025-01-09T01:15:46.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130482025-01-09T01:15:46.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130492025-01-09T01:15:46.981ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130502025-01-09T01:15:46.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130512025-01-09T01:15:46.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130522025-01-09T01:15:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
130532025-01-09T01:15:46.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130542025-01-09T01:15:46.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130552025-01-09T01:15:46.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130562025-01-09T01:15:46.998ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130572025-01-09T01:15:46.998ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
130582025-01-09T01:15:46.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130592025-01-09T01:15:46.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130602025-01-09T01:15:46.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130612025-01-09T01:15:47.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.456171ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130622025-01-09T01:15:47.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130632025-01-09T01:15:47.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130642025-01-09T01:15:47.001ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
130652025-01-09T01:15:47.001ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.68918ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
130662025-01-09T01:15:47.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130672025-01-09T01:15:47.002ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
130682025-01-09T01:15:47.002ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
130692025-01-09T01:15:47.002ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.345213ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
130702025-01-09T01:15:47.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130712025-01-09T01:15:47.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130722025-01-09T01:15:47.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130732025-01-09T01:15:47.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130742025-01-09T01:15:47.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130752025-01-09T01:15:47.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130762025-01-09T01:15:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a, lookup_type: ById(66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a) } result = Ok(())
130772025-01-09T01:15:47.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130782025-01-09T01:15:47.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130792025-01-09T01:15:47.014ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.295484ms iteration = 25 status = 0
130802025-01-09T01:15:47.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
130812025-01-09T01:15:47.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
130822025-01-09T01:15:47.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130832025-01-09T01:15:47.023ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
130842025-01-09T01:15:47.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.616174ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
130852025-01-09T01:15:47.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130862025-01-09T01:15:47.031ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
130872025-01-09T01:15:47.032ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 0 version = 2
130882025-01-09T01:15:47.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130892025-01-09T01:15:47.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130902025-01-09T01:15:47.034ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:03:43.763616Z, time_modified: 2025-01-09T01:03:43.763616Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 795528e9-4767-49c0-875c-03687d636f7a, db_silo: Silo { identity: SiloIdentity { id: 795528e9-4767-49c0-875c-03687d636f7a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:03:48.543860Z, time_modified: 2025-01-09T01:03:48.543860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20" }] }) }
130912025-01-09T01:15:47.035ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 133.936291ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]}},"default_endpoint":{"silo_id":"795528e9-4767-49c0-875c-03687d636f7a","tls_certs":["1c5122998a5eb38033729e38af22a700945f427022118061685c9af3b479cd20"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
130922025-01-09T01:15:47.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.428986ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130932025-01-09T01:15:47.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 143.485777ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130942025-01-09T01:15:47.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130952025-01-09T01:15:47.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130962025-01-09T01:15:47.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130972025-01-09T01:15:47.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130982025-01-09T01:15:47.053ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 73ba0f49-f30e-49af-816d-cb6c540cf141 dns_zone_name = oxide.test found_so_far = 1 version = 2
130992025-01-09T01:15:47.053ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
131002025-01-09T01:15:47.053ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:03:48.597106 UTC dns_group = external generation = 2
131012025-01-09T01:15:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.283626ms iteration = 13 status = {"generation":2}
131022025-01-09T01:15:47.053ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
131032025-01-09T01:15:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
131042025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
131052025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
131062025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
131072025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131082025-01-09T01:15:47.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
131092025-01-09T01:15:47.060ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131102025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131112025-01-09T01:15:47.060ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131122025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
131132025-01-09T01:15:47.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131142025-01-09T01:15:47.060ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b6d399-1d6d-4bdf-978f-a2416d39ed48", "content-length": "26", "date": "Thu, 09 Jan 2025 01:15:46 GMT"} })
131152025-01-09T01:15:47.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131162025-01-09T01:15:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
131172025-01-09T01:15:47.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131182025-01-09T01:15:47.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131192025-01-09T01:15:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131202025-01-09T01:15:47.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131212025-01-09T01:15:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131222025-01-09T01:15:47.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
131232025-01-09T01:15:47.068ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131242025-01-09T01:15:47.068ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d122e001-f8b7-4e34-8d59-aae09a22f9c0", "content-length": "26", "date": "Thu, 09 Jan 2025 01:15:46 GMT"} })
131252025-01-09T01:15:47.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131262025-01-09T01:15:47.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131272025-01-09T01:15:47.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 208.021083ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
131282025-01-09T01:15:47.112ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
131292025-01-09T01:15:47.112ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
131302025-01-09T01:15:47.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131312025-01-09T01:15:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131322025-01-09T01:15:47.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131332025-01-09T01:15:47.115ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131342025-01-09T01:15:47.115ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
131352025-01-09T01:15:47.115ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 213.404314ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
131362025-01-09T01:15:47.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131372025-01-09T01:15:47.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131382025-01-09T01:15:47.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131392025-01-09T01:15:47.120ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3facaddd-3fa1-4e05-a98a-c271eb760019 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
131402025-01-09T01:15:47.120ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
131412025-01-09T01:15:47.120ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:03:46.828566 UTC dns_group = internal generation = 1
131422025-01-09T01:15:47.120ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 219.796939ms iteration = 13 status = {"generation":1}
131432025-01-09T01:15:47.141ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 239.433542ms iteration = 28 status = {"physical_disks_added":0}
131442025-01-09T01:15:47.141ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
131452025-01-09T01:15:47.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 zone_address = fd00:1122:3344:101::2
131462025-01-09T01:15:47.149ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131472025-01-09T01:15:47.150ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36485e4a-2087-4fbc-9f5b-6ad4f069d412", "content-length": "26", "date": "Thu, 09 Jan 2025 01:15:46 GMT"} })
131482025-01-09T01:15:47.150ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131492025-01-09T01:15:47.152ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
131502025-01-09T01:15:47.174ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
131512025-01-09T01:15:47.174ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.685992ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
131522025-01-09T01:15:47.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131532025-01-09T01:15:47.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131542025-01-09T01:15:47.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131552025-01-09T01:15:47.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131562025-01-09T01:15:47.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131572025-01-09T01:15:47.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131582025-01-09T01:15:47.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131592025-01-09T01:15:47.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131602025-01-09T01:15:47.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131612025-01-09T01:15:47.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131622025-01-09T01:15:47.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 273f88d5-4654-4dc4-ae4f-5b99575d74d0 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
131632025-01-09T01:15:47.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 273f88d5-4654-4dc4-ae4f-5b99575d74d0 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
131642025-01-09T01:15:47.189ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
131652025-01-09T01:15:47.197ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 296.133811ms iteration = 25 status = {}
131662025-01-09T01:15:47.239ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
131672025-01-09T01:15:47.239ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6fc82f1-9127-4692-b879-399eb29fb663", "content-length": "2", "date": "Thu, 09 Jan 2025 01:15:46 GMT"} })
131682025-01-09T01:15:47.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131692025-01-09T01:15:47.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131702025-01-09T01:15:47.242ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
131712025-01-09T01:15:47.242ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131722025-01-09T01:15:47.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 273f88d5-4654-4dc4-ae4f-5b99575d74d0 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
131732025-01-09T01:15:47.245ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 345.104597ms iteration = 25 status = null
131742025-01-09T01:15:47.308ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1982d21c-18d1-4598-9449-79d3d24abe2d", "content-length": "372", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
131752025-01-09T01:15:47.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131762025-01-09T01:15:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131772025-01-09T01:15:47.362ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131782025-01-09T01:15:47.362ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3f123a5-0234-4161-8500-98887f7f9ea5", "content-length": "691", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
131792025-01-09T01:15:47.362ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
131802025-01-09T01:15:47.362ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
131812025-01-09T01:15:47.362ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
131822025-01-09T01:15:47.364ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 462.840393ms iteration = 26 status = {}
131832025-01-09T01:15:47.393ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
131842025-01-09T01:15:47.394ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
131852025-01-09T01:15:47.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8b5eb0de-1098-4425-815f-7707ddb50088", "date": "Thu, 09 Jan 2025 01:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131862025-01-09T01:15:47.394ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131872025-01-09T01:15:47.396ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "67244917-7723-4c40-b132-50c9153cb864", "date": "Thu, 09 Jan 2025 01:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131882025-01-09T01:15:47.396ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131892025-01-09T01:15:47.398ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
131902025-01-09T01:15:47.398ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 497.674998ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
131912025-01-09T01:15:47.405ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
131922025-01-09T01:15:47.405ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131932025-01-09T01:15:47.406ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5d6b82fa-f4d4-454b-8d3d-967c6210f1b5", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
131942025-01-09T01:15:47.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131952025-01-09T01:15:47.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131962025-01-09T01:15:47.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131972025-01-09T01:15:47.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131982025-01-09T01:15:47.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131992025-01-09T01:15:47.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132002025-01-09T01:15:47.416ZINFOnexus (BackgroundTasks): VPC route manager sled 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
132012025-01-09T01:15:47.416ZDEBGnexus (BackgroundTasks): client request SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132022025-01-09T01:15:47.417ZDEBGnexus (BackgroundTasks): client response SledAgent = 66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9fc73f41-0514-452d-80f0-63a1f71b90d8", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
132032025-01-09T01:15:47.419ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 517.380393ms iteration = 26 status = {}
132042025-01-09T01:15:47.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
132052025-01-09T01:15:47.454ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "510f31e4-b3da-4421-a6b4-cf438ae4f17b", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132062025-01-09T01:15:47.454ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132072025-01-09T01:15:47.456ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2d48ad81-9d69-4085-b64b-a031d419817c", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132082025-01-09T01:15:47.456ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132092025-01-09T01:15:47.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132102025-01-09T01:15:47.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132112025-01-09T01:15:47.458ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8bac4176-9b50-42b4-bdfb-922996eddcd4", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132122025-01-09T01:15:47.458ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132132025-01-09T01:15:47.459ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: be873185-f758-4791-8f12-a1706a6cf85a, rack_id: 122d04f2-96f1-44ac-9122-b16b480179a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(590aebd0-16c6-471f-b541-75caa44eb538) } rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
132142025-01-09T01:15:47.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132152025-01-09T01:15:47.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132162025-01-09T01:15:47.459ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
132172025-01-09T01:15:47.460ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 559.177776ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
132182025-01-09T01:15:47.469ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
132192025-01-09T01:15:47.469ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5208fed7-9210-4427-8b14-766e806f657d", "content-length": "134", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
132202025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
132212025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 590aebd0-16c6-471f-b541-75caa44eb538
132222025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
132232025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
132242025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132252025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132262025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132272025-01-09T01:15:47.469ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132282025-01-09T01:15:47.470ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
132292025-01-09T01:15:47.470ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
132302025-01-09T01:15:47.470ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5
132312025-01-09T01:15:47.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132322025-01-09T01:15:47.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132332025-01-09T01:15:47.472ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
132342025-01-09T01:15:47.472ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b859c820-e478-4c98-acc4-36e6f88eadf9", "content-length": "2", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
132352025-01-09T01:15:47.472ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
132362025-01-09T01:15:47.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aae8020-b0d9-45e6-b9ca-ed073ce07408", "content-length": "52", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
132372025-01-09T01:15:47.473ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch_location = Switch0
132382025-01-09T01:15:47.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
132392025-01-09T01:15:47.573ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3a591428-de3a-486f-beb7-2cb9c5571a0b", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
132402025-01-09T01:15:47.573ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 switch = Switch0
132412025-01-09T01:15:47.573ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
132422025-01-09T01:15:47.574ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 122d04f2-96f1-44ac-9122-b16b480179a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b756fdd-78a5-41de-82d6-c8179890e4c9", "content-length": "682", "date": "Thu, 09 Jan 2025 01:15:47 GMT"} })
132432025-01-09T01:15:47.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132442025-01-09T01:15:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132452025-01-09T01:15:47.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132462025-01-09T01:15:47.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132472025-01-09T01:15:47.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132482025-01-09T01:15:47.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132492025-01-09T01:15:47.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132502025-01-09T01:15:47.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132512025-01-09T01:15:47.589ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.268119ms iteration = 25 status = {}
132522025-01-09T01:15:48.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cecd44c3-5570-4ca3-8acb-12670a2d9fdf roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132532025-01-09T01:15:48.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cecd44c3-5570-4ca3-8acb-12670a2d9fdf resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132542025-01-09T01:15:48.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cecd44c3-5570-4ca3-8acb-12670a2d9fdf response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132552025-01-09T01:15:49.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cfb917fe-8d4f-4da0-81c2-66827633c405 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132562025-01-09T01:15:49.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cfb917fe-8d4f-4da0-81c2-66827633c405 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132572025-01-09T01:15:49.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = cfb917fe-8d4f-4da0-81c2-66827633c405 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132582025-01-09T01:15:49.944ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 683 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = 4c4aa427-f057-44a7-a8ec-b37268370dc1 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
132592025-01-09T01:15:50.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9fab2dc3-f486-48b6-a829-14b67cd9b9ae roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132602025-01-09T01:15:50.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9fab2dc3-f486-48b6-a829-14b67cd9b9ae resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132612025-01-09T01:15:50.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9fab2dc3-f486-48b6-a829-14b67cd9b9ae response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132622025-01-09T01:15:51.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 05e3cd01-37bd-4ec2-b0e9-4ecda8033801 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132632025-01-09T01:15:51.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 05e3cd01-37bd-4ec2-b0e9-4ecda8033801 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132642025-01-09T01:15:51.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 05e3cd01-37bd-4ec2-b0e9-4ecda8033801 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132652025-01-09T01:15:52.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9f3d9021-7a5b-474a-9f96-18a57e647b24 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132662025-01-09T01:15:52.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9f3d9021-7a5b-474a-9f96-18a57e647b24 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132672025-01-09T01:15:52.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 9f3d9021-7a5b-474a-9f96-18a57e647b24 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132682025-01-09T01:15:53.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cdeff52-1b04-4e8b-96cf-4b6c2afc5c2b roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132692025-01-09T01:15:53.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cdeff52-1b04-4e8b-96cf-4b6c2afc5c2b resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132702025-01-09T01:15:53.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 4cdeff52-1b04-4e8b-96cf-4b6c2afc5c2b response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132712025-01-09T01:15:54.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a270abd5-f74c-4e15-ba0c-07190ccbdf32 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132722025-01-09T01:15:54.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a270abd5-f74c-4e15-ba0c-07190ccbdf32 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132732025-01-09T01:15:54.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a270abd5-f74c-4e15-ba0c-07190ccbdf32 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132742025-01-09T01:15:55.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3882d9cd-412a-448c-9975-c48b18448646 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132752025-01-09T01:15:55.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3882d9cd-412a-448c-9975-c48b18448646 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132762025-01-09T01:15:55.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3882d9cd-412a-448c-9975-c48b18448646 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132772025-01-09T01:15:56.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 97b0373a-059b-4ac0-b269-a972d9d94e64 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132782025-01-09T01:15:56.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 97b0373a-059b-4ac0-b269-a972d9d94e64 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132792025-01-09T01:15:56.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 97b0373a-059b-4ac0-b269-a972d9d94e64 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
132802025-01-09T01:15:56.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
132812025-01-09T01:15:56.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
132822025-01-09T01:15:56.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132832025-01-09T01:15:56.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132842025-01-09T01:15:56.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132852025-01-09T01:15:56.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132862025-01-09T01:15:56.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132872025-01-09T01:15:56.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132882025-01-09T01:15:56.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132892025-01-09T01:15:56.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132902025-01-09T01:15:56.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132912025-01-09T01:15:56.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132922025-01-09T01:15:56.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132932025-01-09T01:15:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
132942025-01-09T01:15:56.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132952025-01-09T01:15:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132962025-01-09T01:15:56.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
132972025-01-09T01:15:56.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.522848ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
132982025-01-09T01:15:56.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132992025-01-09T01:15:56.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133002025-01-09T01:15:56.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.493507ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133012025-01-09T01:15:57.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcd15ac1-35b7-4729-962a-07043dcbb6d9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133022025-01-09T01:15:57.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcd15ac1-35b7-4729-962a-07043dcbb6d9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133032025-01-09T01:15:57.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = dcd15ac1-35b7-4729-962a-07043dcbb6d9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133042025-01-09T01:15:58.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7e97f27f-e17a-49d1-b45d-b2df887b88a9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133052025-01-09T01:15:58.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7e97f27f-e17a-49d1-b45d-b2df887b88a9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133062025-01-09T01:15:58.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 7e97f27f-e17a-49d1-b45d-b2df887b88a9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133072025-01-09T01:15:59.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f656bc7d-6091-4734-b755-0590fdd81b48 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133082025-01-09T01:15:59.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f656bc7d-6091-4734-b755-0590fdd81b48 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133092025-01-09T01:15:59.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = f656bc7d-6091-4734-b755-0590fdd81b48 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133102025-01-09T01:15:59.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 180298ea-259b-41c8-bcb7-cb3d2b6606db roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
133112025-01-09T01:15:59.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 180298ea-259b-41c8-bcb7-cb3d2b6606db resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
133122025-01-09T01:15:59.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 180298ea-259b-41c8-bcb7-cb3d2b6606db response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?sort_by=id_ascending
133132025-01-09T01:15:59.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 0ad875a5-08d1-4baa-9324-e800d72e44a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
133142025-01-09T01:15:59.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 0ad875a5-08d1-4baa-9324-e800d72e44a8 resource = Database result = Ok(()) uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
133152025-01-09T01:15:59.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62664 req_id = 0ad875a5-08d1-4baa-9324-e800d72e44a8 response_code = 200 uri = /metrics/collectors/d369b97b-e309-4e30-bf3f-1e4b78ee9699/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmZiMGFhZC0xOTMyLTRhNDQtODkxYy0yNzM5OTkxZDE5MzQifX0%3D
133162025-01-09T01:15:59.943ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 439 local_addr = [fd00:1122:3344:101::c]:35467 method = GET remote_addr = [fd00:1122:3344:101::d]:43603 req_id = a3df6c46-b50a-4026-a067-6cf21c1697d6 response_code = 200 uri = /bc5aeb1b-883b-4e3c-84e4-bb4b98458327
133172025-01-09T01:16:00.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a2e10be-ef50-4c40-8697-112e003e6d1f roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133182025-01-09T01:16:00.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a2e10be-ef50-4c40-8697-112e003e6d1f resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133192025-01-09T01:16:00.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a2e10be-ef50-4c40-8697-112e003e6d1f response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133202025-01-09T01:16:01.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b865339-d703-495f-975d-e175a86e7607 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133212025-01-09T01:16:01.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b865339-d703-495f-975d-e175a86e7607 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133222025-01-09T01:16:01.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 0b865339-d703-495f-975d-e175a86e7607 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133232025-01-09T01:16:02.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27f50237-a2a5-4f15-981a-32ce542e18d2 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133242025-01-09T01:16:02.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27f50237-a2a5-4f15-981a-32ce542e18d2 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133252025-01-09T01:16:02.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 27f50237-a2a5-4f15-981a-32ce542e18d2 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133262025-01-09T01:16:03.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a3808d28-c66d-4e2c-89cc-2fcbc3b098d6 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133272025-01-09T01:16:03.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a3808d28-c66d-4e2c-89cc-2fcbc3b098d6 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133282025-01-09T01:16:03.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a3808d28-c66d-4e2c-89cc-2fcbc3b098d6 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133292025-01-09T01:16:04.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a0c354b-0688-4745-9289-d360d7a05447 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133302025-01-09T01:16:04.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a0c354b-0688-4745-9289-d360d7a05447 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133312025-01-09T01:16:04.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 5a0c354b-0688-4745-9289-d360d7a05447 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133322025-01-09T01:16:05.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4ef4c4f-0b87-4fb2-a5ad-22cd84fe01e9 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133332025-01-09T01:16:05.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4ef4c4f-0b87-4fb2-a5ad-22cd84fe01e9 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133342025-01-09T01:16:05.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = a4ef4c4f-0b87-4fb2-a5ad-22cd84fe01e9 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133352025-01-09T01:16:06.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e968ac9-1a90-473d-aaaf-b07c1ce56391 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133362025-01-09T01:16:06.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e968ac9-1a90-473d-aaaf-b07c1ce56391 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133372025-01-09T01:16:06.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 2e968ac9-1a90-473d-aaaf-b07c1ce56391 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133382025-01-09T01:16:06.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
133392025-01-09T01:16:06.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133402025-01-09T01:16:06.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
133412025-01-09T01:16:06.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133422025-01-09T01:16:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133432025-01-09T01:16:06.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133442025-01-09T01:16:06.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133452025-01-09T01:16:06.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133462025-01-09T01:16:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133472025-01-09T01:16:06.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.241996ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133482025-01-09T01:16:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133492025-01-09T01:16:06.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133502025-01-09T01:16:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133512025-01-09T01:16:06.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133522025-01-09T01:16:06.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133532025-01-09T01:16:06.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133542025-01-09T01:16:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9d9f3a47-353f-408c-96b6-820cac6e34a4, lookup_type: ById(9d9f3a47-353f-408c-96b6-820cac6e34a4) } result = Ok(())
133552025-01-09T01:16:06.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133562025-01-09T01:16:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133572025-01-09T01:16:06.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 original_time_created = 2025-01-09 01:03:40.605109 UTC target_id = 9d9f3a47-353f-408c-96b6-820cac6e34a4 time_created = 2025-01-09 01:03:40.605109 UTC
133582025-01-09T01:16:06.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.549561ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9d9f3a47-353f-408c-96b6-820cac6e34a4","time_created":"2025-01-09T01:03:40.605109Z"}
133592025-01-09T01:16:07.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82b634d4-4c6a-4434-8f71-13e06855426e roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133602025-01-09T01:16:07.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82b634d4-4c6a-4434-8f71-13e06855426e resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133612025-01-09T01:16:07.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 82b634d4-4c6a-4434-8f71-13e06855426e response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133622025-01-09T01:16:08.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = baa67474-5bbe-443d-a655-7b5dc39098c4 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133632025-01-09T01:16:08.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = baa67474-5bbe-443d-a655-7b5dc39098c4 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133642025-01-09T01:16:08.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = baa67474-5bbe-443d-a655-7b5dc39098c4 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133652025-01-09T01:16:09.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3a85d053-bd93-4f9e-9521-980b90ed8975 roles = RoleSet { roles: {} } uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133662025-01-09T01:16:09.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3a85d053-bd93-4f9e-9521-980b90ed8975 resource = Database result = Ok(()) uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a
133672025-01-09T01:16:09.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49357 req_id = 3a85d053-bd93-4f9e-9521-980b90ed8975 response_code = 200 uri = /probes/66e03bc8-0dd2-4f2a-93c0-ce1c4f2f1e4a